00000001:02000400:2.0F:1788687531.072389:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788687549.269213:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788687551.232657:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 595 MB/s 00000001:01000000:3.0F:1788687551.482737:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 619 MB/s 00000001:01000000:3.0:1788687551.734469:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4585 MB/s 00000020:02000000:3.0:1788687552.615782:0:3279:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g2f2534e 00000400:02000000:3.0:1788687553.497437:0:3294:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.126@tcp [8/256/0/180] 00008000:02000000:2.0:1788687557.159712:0:3443:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788687603.243832:0:5247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing load_modules_local 00000020:01000004:0.0F:1788687611.330916:0:5820:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788687611.330926:0:5820:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788687611.331263:0:5820:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f147ea4a 00000080:02000400:0.0:1788687611.331274:0:5820:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788687611.341515:0:5820:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788687611.341528:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788687611.341566:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000019c522b1) 00000020:00000080:0.0:1788687611.341584:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788687611.366258:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788687611.366741:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788687611.391856:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788687611.391899:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788687611.391921:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788687611.392168:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788687611.392205:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788687611.392601:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788687611.392609:0:5820:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788687611.392619:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e744489fc 00000020:01000004:3.0:1788687611.392626:0:5820:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788687611.392631:0:5820:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788687611.392636:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f147ea4a from MGS 00000020:01000004:3.0:1788687611.392640:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788687611.392657:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000091725900) 00000020:00000080:3.0:1788687611.392668:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788687611.392757:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f147ea4a from MGS, refs=2 00080000:01000000:3.0:1788687611.392762:0:5820:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788687611.392766:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74448a0a 00000100:00100000:3.0:1788687611.392858:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788687611.393096:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788687611.393102:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788687611.393727:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788687611.393742:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788687611.394457:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687611.394742:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788687611.394747:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788687611.395822:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788687611.395831:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788687611.396362:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788687611.396370:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788687611.397045:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687611.397049:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687611.397050:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687611.397367:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687611.397370:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687611.397371:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687611.398627:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788687611.400861:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788687611.650753:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2711 MB/s 00000001:01000000:2.0:1788687611.900929:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3351 MB/s 00000001:01000000:0.0:1788687612.151526:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 593 MB/s 00000001:01000000:2.0:1788687612.403217:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 844 MB/s 00080000:10000000:3.0:1788687612.419360:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1788687612.421681:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788687612.436377:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788687612.436394:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788687612.436397:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788687612.438080:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788687612.438145:0:5820:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788687612.438194:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788687612.438417:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788687612.438442:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788687612.439121:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788687612.439283:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788687612.439289:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788687612.446700:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788687612.446717:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788687612.447256:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788687612.447263:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788687612.447938:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788687612.447962:0:5820:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.126@tcp' 00000020:01000004:1.0:1788687612.447964:0:5820:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788687612.448027:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.126@tcp (typ=mgc) 00000020:00000080:1.0:1788687612.448046:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.126@tcp (00000000a8b1b62f) 00000020:00000080:1.0:1788687612.448064:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788687612.448161:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000670a55f8@MGC192.168.204.126@tcp: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788687612.448432:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.126@tcp-0 is initialized 00000040:01000000:1.0:1788687612.448440:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788687612.449088:0:5835:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788687612.451732:0:5836:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788687612.451783:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.126@tcp (uuid 06ee7184-cb77-4c4b-8fd0-7ddc21a66059) 00000020:00000080:0.0:1788687612.451813:0:5820:0:(genops.c:1385:class_connect()) connect: client 06ee7184-cb77-4c4b-8fd0-7ddc21a66059, cookie 0xc2ddd83e74448a18 00000100:00080000:0.0:1788687612.451825:0:5820:0:(import.c:545:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788687612.451830:0:5820:0:(import.c:665:import_select_connection()) MGC192.168.204.126@tcp: import 00000000670a55f8 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788687612.451871:0:5820:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000023f4c6d x1875574839574656/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788687612.451890:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS 00000020:01000004:0.0:1788687612.451910:0:5820:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788687612.451915:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788687612.451928:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000fd751dc4) 00000020:00000080:0.0:1788687612.451939:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788687612.453018:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000023f4c6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3309:1875574839574656:0@lo:250: 00000100:00100000:3.0:1788687612.453128:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687612.453210:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839574656 00000100:00100000:3.0:1788687612.453218:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839574656 00000100:00100000:3.0:1788687612.453248:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788687612.453255:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae1e1975 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875574839574656:12345-0@lo:250: 00010000:00080000:3.0:1788687612.453278:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 06ee7184-cb77-4c4b-8fd0-7ddc21a66059@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:3.0:1788687612.453317:0:5831:0:(genops.c:1385:class_connect()) connect: client 06ee7184-cb77-4c4b-8fd0-7ddc21a66059, cookie 0xc2ddd83e74448a26 00000100:00080000:3.0:1788687612.453477:0:5831:0:(import.c:65:import_set_state_nolock()) 000000008bd45719 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788687612.453566:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae1e1975 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:3309:x1875574839574656:12345-0@lo:250: Request processed in 311us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687612.453575:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788687612.454236:0:3309:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788687612.454247:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00080000:3.0:1788687612.454256:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788687612.454260:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788687612.454263:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000670a55f8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788687612.454266:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788687612.454277:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788687612.454281:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000023f4c6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3309:1875574839574656:0@lo:250: 00000100:00100000:3.0:1788687612.464273:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687612.464533:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788687612.464544:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788687612.465928:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788687612.465938:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788687612.468796:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788687612.468811:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788687612.469946:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687612.470133:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788687612.470139:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788687612.470808:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788687612.470816:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788687612.507613:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687612.507843:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788687612.507851:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788687612.509869:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788687612.509888:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788687612.510596:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687612.510773:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788687612.510778:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788687612.512516:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788687612.512526:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788687612.513409:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687612.513743:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788687612.513749:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788687612.516636:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788687612.516652:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788687612.517433:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687612.517790:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788687612.517796:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788687612.518986:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788687612.518995:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788687612.554425:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788687612.554671:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788687612.554677:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788687612.557238:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788687612.557254:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788687612.559023:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788687612.559036:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788687612.560664:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788687612.560688:0:5820:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788687612.560694:0:5820:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788687612.560818:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788687612.560852:0:5820:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788687612.560857:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788687612.560859:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788687612.560860:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788687612.560861:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788687612.560862:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788687612.560867:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788687612.560869:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788687612.560870:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788687612.560871:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788687612.560872:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788687612.560874:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788687612.560875:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788687612.560877:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788687612.560879:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788687612.560880:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788687612.560881:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788687612.560882:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788687612.560883:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788687612.560883:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788687612.560884:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788687612.560885:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788687612.560886:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788687612.560886:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788687612.560887:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788687612.560888:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788687612.560931:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788687612.561024:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000346363fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839574784:0@lo:253: 00000100:00100000:3.0:1788687612.561101:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687612.561152:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dcf9eab8 going to sleep for 11 seconds 00000100:00100000:2.0:1788687612.561216:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839574784 00000100:00100000:2.0:1788687612.561224:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839574784 00000100:00100000:2.0:1788687612.561285:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788687612.561294:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ce8cb2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:5820:x1875574839574784:12345-0@lo:253: 20000000:01000000:2.0:1788687612.561337:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788687612.561340:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788687612.561641:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788687612.561696:0:5834:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788687612.562092:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788687612.564794:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788687612.565115:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788687612.565170:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788687612.565176:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788687612.565179:0:5834:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788687612.565197:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788687612.565424:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788687612.565790:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788687612.565804:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788687612.565843:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788687612.565881:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788687612.565909:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788687612.565997:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788687612.566005:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788687612.566050:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788687612.566057:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788687612.566082:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788687612.566091:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788687612.566130:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788687612.566180:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788687612.566214:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788687612.566219:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788687612.566232:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788687612.566409:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788687612.566418:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788687612.566444:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788687612.566519:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788687612.566560:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788687612.566569:0:5834:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788687612.566626:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788687612.566633:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788687612.566667:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788687612.566694:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788687612.566733:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788687612.566743:0:5834:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788687612.566809:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788687612.566816:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788687612.566840:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788687612.566866:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788687612.567006:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788687612.567047:0:5834:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788687612.567054:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788687612.567693:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788687612.567933:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788687612.568012:0:5834:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.126@tcp for mdt 20000000:01000000:2.0:1788687612.568015:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788687612.568049:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788687612.568064:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788687612.568098:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788687612.568105:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:2.0:1788687612.568215:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788687612.568227:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788687612.568261:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788687612.568310:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788687612.568373:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788687612.568376:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788687612.568379:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788687612.568391:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788687612.568393:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788687612.568418:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788687612.568420:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788687612.569089:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788687612.569386:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788687612.569428:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788687612.569660:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788687612.569674:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788687612.569677:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788687612.570070:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788687612.570338:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788687612.570380:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788687612.570415:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788687612.570427:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788687612.570429:0:5834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788687612.570433:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788687612.570435:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788687612.570439:0:5834:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788687612.570445:0:5834:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788687612.571751:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788687612.571885:0:5834:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788687612.584794:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788687612.584852:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788687612.584926:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788687612.584982:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788687612.585003:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.585019:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.585028:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.585033:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.585039:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.585044:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.585049:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000035acf05d already unused, calling callback (000000000eecaf44) 00010000:00010000:3.0:1788687612.585052:0:5834:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.585058:0:5834:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.585069:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.585076:0:5834:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.585081:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788687612.585109:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788687612.782386:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ce8cb2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:5820:x1875574839574784:12345-0@lo:253: Request processed in 221085us (221276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687612.782401:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788687612.782520:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000346363fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839574784:0@lo:253: 10000000:01000000:2.0:1788687612.782820:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788687612.782824:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788687612.782826:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788687612.782827:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788687612.782828:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788687612.782829:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788687612.782830:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788687612.782832:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788687612.782833:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788687612.782834:0:5820:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788687612.782836:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788687612.782837:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788687612.782857:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f147ea4a from lustre-MDT0000 10000000:01000000:2.0:1788687612.782881:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788687612.782883:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788687612.782887:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9af3e0230000 10000000:01000000:2.0:1788687612.782891:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788687612.782898:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af3e0230000 from 1 10000000:01000000:2.0:1788687612.782901:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788687612.783015:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 0000000034e0e81e/0xc2ddd83e74448a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.783026:0:5820:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 0000000034e0e81e/0xc2ddd83e74448a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.783035:0:5820:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 0000000034e0e81e/0xc2ddd83e74448a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687612.783052:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839574912:0@lo:101: 00000100:00100000:2.0:1788687612.783104:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687612.783212:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5017bab going to sleep for 11 seconds 00000100:00100000:3.0:1788687612.783320:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839574912 00000100:00100000:3.0:1788687612.783327:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839574912 00000100:00100000:3.0:1788687612.783405:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788687612.783413:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d86ec31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:5820:x1875574839574912:12345-0@lo:101: 00010000:00010000:3.0:1788687612.783425:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687612.783438:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448a34 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.783471:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448a34 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.783508:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035acf05d/0xc2ddd83e74448a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448a34 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687612.783519:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035acf05d, rc 0) 00000100:00100000:3.0:1788687612.783557:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d86ec31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+6:5820:x1875574839574912:12345-0@lo:101: Request processed in 145us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687612.783564:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788687612.783663:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839574912:0@lo:101: 00010000:00010000:2.0:1788687612.783686:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 0000000034e0e81e/0xc2ddd83e74448a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.783694:0:5820:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 0000000034e0e81e/0xc2ddd83e74448a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687612.783741:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575040:0@lo:501: 00000100:00100000:2.0:1788687612.783767:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687612.783862:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5017bab going to sleep for 11 seconds 00000100:00100000:0.0:1788687612.783950:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839575040 00000100:00100000:0.0:1788687612.783955:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839575040 00000100:00100000:0.0:1788687612.783976:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788687612.783982:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000661c3bad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+6:5820:x1875574839575040:12345-0@lo:501: 00000100:00100000:0.0:1788687612.784223:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000661c3bad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+6:5820:x1875574839575040:12345-0@lo:501: Request processed in 241us (455us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788687612.784231:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788687612.784363:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575040:0@lo:501: 10000000:01000000:2.0:1788687612.784388:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788687612.784405:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 0000000034e0e81e/0xc2ddd83e74448a34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.784413:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 0000000034e0e81e/0xc2ddd83e74448a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687612.784421:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9af3e6e77800 10000000:01000000:2.0:1788687612.784425:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788687612.784429:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9af3e6e77800 10000000:01000000:2.0:1788687612.784431:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788687612.784434:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9af3e6e77800 from 1 10000000:01000000:2.0:1788687612.784436:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788687612.784463:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000565f6da3/0xc2ddd83e74448a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.784470:0:5820:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000565f6da3/0xc2ddd83e74448a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.784509:0:5820:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000565f6da3/0xc2ddd83e74448a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687612.784522:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575168:0@lo:101: 00000100:00100000:2.0:1788687612.784548:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687612.784561:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5017bab going to sleep for 11 seconds 00000100:00100000:0.0:1788687612.784624:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839575168 00000100:00100000:0.0:1788687612.784628:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839575168 00000100:00100000:0.0:1788687612.784646:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788687612.784651:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016c294c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+6:5820:x1875574839575168:12345-0@lo:101: 00010000:00010000:0.0:1788687612.784658:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687612.784669:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000778dd411/0xc2ddd83e74448a49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448a42 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687612.784684:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000778dd411/0xc2ddd83e74448a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448a42 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687612.784691:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000778dd411/0xc2ddd83e74448a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448a42 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687612.784698:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000778dd411, rc 0) 00000100:00100000:0.0:1788687612.784732:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016c294c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+7:5820:x1875574839575168:12345-0@lo:101: Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687612.784737:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788687612.784805:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575168:0@lo:101: 00010000:00010000:2.0:1788687612.784816:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000565f6da3/0xc2ddd83e74448a42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.784823:0:5820:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000565f6da3/0xc2ddd83e74448a42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687612.784834:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788687612.784847:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000565f6da3/0xc2ddd83e74448a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.784853:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000565f6da3/0xc2ddd83e74448a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687612.784859:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788687612.784862:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788687612.784866:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9af3e6e77800 10000000:01000000:2.0:1788687612.784869:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788687612.784872:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788687612.784874:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788687612.784887:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000df023cb6/0xc2ddd83e74448a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.784899:0:5820:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000df023cb6/0xc2ddd83e74448a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.784906:0:5820:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000df023cb6/0xc2ddd83e74448a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687612.784917:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575296:0@lo:101: 00000100:00100000:2.0:1788687612.784955:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687612.784974:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5017bab going to sleep for 11 seconds 00000100:00100000:0.0:1788687612.785078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839575296 00000100:00100000:0.0:1788687612.785085:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839575296 00000100:00100000:0.0:1788687612.785103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788687612.785107:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a8d3523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+7:5820:x1875574839575296:12345-0@lo:101: 00010000:00010000:0.0:1788687612.785119:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687612.785126:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ace9abe/0xc2ddd83e74448a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448a50 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687612.785138:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ace9abe/0xc2ddd83e74448a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448a50 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687612.785144:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ace9abe/0xc2ddd83e74448a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448a50 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687612.785149:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ace9abe, rc 0) 00000100:00100000:0.0:1788687612.785186:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a8d3523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+8:5820:x1875574839575296:12345-0@lo:101: Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687612.785191:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788687612.785272:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575296:0@lo:101: 00010000:00010000:2.0:1788687612.785281:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000df023cb6/0xc2ddd83e74448a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687612.785287:0:5820:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000df023cb6/0xc2ddd83e74448a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687612.785323:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575424:0@lo:501: 00000100:00100000:2.0:1788687612.785346:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687612.785367:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5017bab going to sleep for 11 seconds 00000100:00100000:0.0:1788687612.785416:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839575424 00000100:00100000:0.0:1788687612.785420:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839575424 00000100:00100000:0.0:1788687612.785436:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788687612.785441:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5c2ed93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+8:5820:x1875574839575424:12345-0@lo:501: 00000100:00100000:0.0:1788687612.785657:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5c2ed93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:5820:x1875574839575424:12345-0@lo:501: Request processed in 216us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687612.785664:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788687612.785740:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575424:0@lo:501: 00000100:00100000:2.0:1788687612.785766:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575552:0@lo:503: 00000100:00100000:2.0:1788687612.785804:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687612.785829:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5017bab going to sleep for 11 seconds 00000100:00100000:0.0:1788687612.785877:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839575552 00000100:00100000:0.0:1788687612.785881:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839575552 00000100:00100000:0.0:1788687612.785897:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788687612.785901:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b578692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:5820:x1875574839575552:12345-0@lo:503: 00000100:00100000:0.0:1788687612.786115:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b578692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:5820:x1875574839575552:12345-0@lo:503: Request processed in 213us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687612.786122:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788687612.786206:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575552:0@lo:503: 00000100:00100000:2.0:1788687612.786716:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5862:1875574839575680:0@lo:502: 00000100:00100000:2.0:1788687612.786760:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687612.786825:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040a72b10 going to sleep for 11 seconds 00000100:00100000:0.0:1788687612.786862:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839575680 00000100:00100000:0.0:1788687612.786867:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839575680 00000100:00100000:0.0:1788687612.786930:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788687612.786937:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b1e116b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:5862:x1875574839575680:12345-0@lo:502: 00000100:00100000:0.0:1788687612.787211:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b1e116b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:5862:x1875574839575680:12345-0@lo:502: Request processed in 275us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687612.787218:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788687612.787295:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5862:1875574839575680:0@lo:502: 00000020:01000000:2.0:1788687612.787318:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788687612.787330:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687612.787333:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788687612.787341:0:5862:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788687612.787344:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788687612.787368:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000fdd7b80c) 00000020:00000080:2.0:1788687612.787388:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788687612.787393:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788687612.787595:0:5862:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788687612.787603:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74448a65 00000020:00000080:2.0:1788687612.787820:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788687612.787825:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788687612.787829:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687612.787830:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788687612.787832:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788687612.787835:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687612.787836:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788687612.787840:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788687612.787846:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000088fc28c2) 00000020:00000080:2.0:1788687612.787856:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788687612.787858:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788687612.787860:0:5862:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788687612.787863:0:5862:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788687612.787868:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788687612.787910:0:5862:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f147ea4a from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788687612.787919:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c531a139) 00000020:00000080:2.0:1788687612.787926:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788687612.788110:0:5862:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788687612.788122:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2ddd83e74448a7a 00000020:00000080:2.0:1788687612.788203:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788687612.788209:0:5862:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788687612.788213:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc2ddd83e74448a81 00080000:01000000:2.0:1788687612.788217:0:5862:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788687612.788220:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74448a88 00080000:10000000:2.0:1788687612.788694:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788687612.788895:0:5862:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788687612.794591:0:5862:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788687612.851153:0:5862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788687612.851715:0:5862:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788687612.854103:0:5862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788687612.854372:0:5862:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788687612.879743:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001499ca7d) 00000020:00000080:0.0:1788687612.879766:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788687612.879839:0:5862:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788687612.879845:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74448a96 00000020:00000080:3.0:1788687612.880261:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788687612.881712:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788687612.923187:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687612.949898:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788687612.975884:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788687613.012584:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687613.049657:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788687613.077807:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc2ddd83e74448a9d 00000020:00000080:3.0:1788687613.078242:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788687613.078258:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687613.078264:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687613.078265:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788687613.078269:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687613.078273:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687613.078274:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788687613.078277:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788687613.078279:0:5862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788687613.078281:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687613.078283:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687613.078284:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788687613.078286:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687613.078291:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687613.078292:0:5862:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788687613.078296:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788687613.078334:0:5862:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788687613.078389:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083beef26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5862:1875574839575808:0@lo:502: 00000100:00100000:3.0:1788687613.078517:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687613.078572:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040a72b10 going to sleep for 11 seconds 00000100:00100000:0.0:1788687613.078692:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839575808 00000100:00100000:0.0:1788687613.078700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839575808 00000100:00100000:0.0:1788687613.078749:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788687613.078757:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059d0d8aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:5862:x1875574839575808:12345-0@lo:502: 00000100:00100000:0.0:1788687613.079083:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059d0d8aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:5862:x1875574839575808:12345-0@lo:502: Request processed in 326us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687613.079090:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788687613.079270:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083beef26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5862:1875574839575808:0@lo:502: 00000020:01000000:3.0:1788687613.079299:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687613.079306:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687613.079308:0:5862:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788687613.079312:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788687613.079690:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788687613.079708:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788687613.079730:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000df023cb6/0xc2ddd83e74448a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.079741:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000df023cb6/0xc2ddd83e74448a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687613.079760:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af3e6e77800 from 1 10000000:01000000:0.0:1788687613.079763:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788687613.079791:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.079798:0:5820:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.079807:0:5820:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687613.079823:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000beed548d pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575936:0@lo:101: 00000100:00100000:0.0:1788687613.079859:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687613.079975:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee3b4164 going to sleep for 11 seconds 00000100:00100000:2.0:1788687613.080161:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839575936 00000100:00100000:2.0:1788687613.080167:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839575936 00000100:00100000:2.0:1788687613.080236:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788687613.080243:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a3fef5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:5820:x1875574839575936:12345-0@lo:101: 00010000:00010000:2.0:1788687613.080254:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687613.080268:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c999ce8/0xc2ddd83e74448aab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448aa4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687613.080287:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c999ce8/0xc2ddd83e74448aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448aa4 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687613.080296:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c999ce8/0xc2ddd83e74448aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448aa4 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687613.080303:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c999ce8, rc 0) 00000100:00100000:2.0:1788687613.080344:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a3fef5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:5820:x1875574839575936:12345-0@lo:101: Request processed in 102us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687613.080351:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788687613.080424:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000beed548d pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839575936:0@lo:101: 00010000:00010000:1.0:1788687613.080437:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.080458:0:5820:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687613.081028:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576064:0@lo:256: 00000100:00100000:1.0:1788687613.081092:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687613.081354:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd66150 going to sleep for 11 seconds 00000100:00100000:0.0:1788687613.081430:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839576064 00000100:00100000:0.0:1788687613.081437:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839576064 00000100:00100000:0.0:1788687613.081473:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788687613.081494:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024113b0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:5820:x1875574839576064:12345-0@lo:256: 20000000:01000000:0.0:1788687613.081510:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788687613.081516:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788687613.081590:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024113b0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:5820:x1875574839576064:12345-0@lo:256: Request processed in 110us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687613.081597:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788687613.081676:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576064:0@lo:256: 10000000:01000000:1.0:1788687613.082273:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788687613.082300:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.082308:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687613.082315:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3e6e77800 from 1 10000000:01000000:1.0:1788687613.082317:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687613.082346:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.082353:0:5820:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.082362:0:5820:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687613.082376:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576192:0@lo:101: 00000100:00100000:1.0:1788687613.082411:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687613.082454:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd66150 going to sleep for 11 seconds 00000100:00100000:1.0:1788687613.082474:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839576192 00000100:00100000:1.0:1788687613.082502:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839576192 00000100:00100000:1.0:1788687613.082529:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788687613.082535:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6d159e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:5820:x1875574839576192:12345-0@lo:101: 00010000:00010000:1.0:1788687613.082543:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687613.082563:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e0bcc02/0xc2ddd83e74448ab9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448ab2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.082581:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e0bcc02/0xc2ddd83e74448ab9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448ab2 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.082590:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e0bcc02/0xc2ddd83e74448ab9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448ab2 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.082599:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e0bcc02, rc 0) 00000100:00100000:1.0:1788687613.082627:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6d159e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:5820:x1875574839576192:12345-0@lo:101: Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687613.082633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788687613.082669:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576192:0@lo:101: 00010000:00010000:1.0:1788687613.082680:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.082687:0:5820:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687613.082730:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576320:0@lo:501: 00000100:00100000:1.0:1788687613.082754:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687613.082766:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd66150 going to sleep for 11 seconds 00000100:00100000:1.0:1788687613.082779:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839576320 00000100:00100000:1.0:1788687613.082782:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839576320 00000100:00100000:1.0:1788687613.082797:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788687613.082803:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ed84d3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:5820:x1875574839576320:12345-0@lo:501: 00000100:00100000:1.0:1788687613.083316:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ed84d3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:5820:x1875574839576320:12345-0@lo:501: Request processed in 513us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687613.083331:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788687613.083393:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576320:0@lo:501: 00000100:00100000:1.0:1788687613.083419:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576448:0@lo:503: 00000100:00100000:1.0:1788687613.083471:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687613.083509:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd66150 going to sleep for 11 seconds 00000100:00100000:1.0:1788687613.083522:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839576448 00000100:00100000:1.0:1788687613.083525:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839576448 00000100:00100000:1.0:1788687613.083542:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788687613.083546:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a186fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:5820:x1875574839576448:12345-0@lo:503: 00000040:00080000:1.0:1788687613.083577:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788687613.083611:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a186fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:5820:x1875574839576448:12345-0@lo:503: Request processed in 65us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687613.083617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788687613.083649:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576448:0@lo:503: 00000040:00080000:1.0:1788687613.084274:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788687613.084333:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788687613.084348:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788687613.084356:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.084365:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687613.084402:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788687613.084405:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9af3e6e77800 10000000:01000000:1.0:1788687613.084408:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9af3e6e77800 10000000:01000000:1.0:1788687613.084413:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788687613.084427:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3e6e77800 from 1 10000000:01000000:1.0:1788687613.084429:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788687613.084469:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000008787d6ef/0xc2ddd83e74448ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.084862:0:5820:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000008787d6ef/0xc2ddd83e74448ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.084871:0:5820:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000008787d6ef/0xc2ddd83e74448ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687613.084887:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576576:0@lo:101: 00000100:00100000:1.0:1788687613.084931:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687613.085061:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000114b5a15 going to sleep for 11 seconds 00000100:00100000:3.0:1788687613.085196:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839576576 00000100:00100000:3.0:1788687613.085203:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839576576 00000100:00100000:3.0:1788687613.085290:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788687613.085303:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f88cfcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:5820:x1875574839576576:12345-0@lo:101: 00010000:00010000:3.0:1788687613.085315:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687613.085327:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006130ef1e/0xc2ddd83e74448ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448ac0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687613.085358:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006130ef1e/0xc2ddd83e74448ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448ac0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687613.085366:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006130ef1e/0xc2ddd83e74448ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448ac0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687613.085375:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006130ef1e, rc 0) 00000100:00100000:3.0:1788687613.085414:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f88cfcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5820:x1875574839576576:12345-0@lo:101: Request processed in 116us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687613.085420:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788687613.085519:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576576:0@lo:101: 00010000:00010000:1.0:1788687613.085531:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000008787d6ef/0xc2ddd83e74448ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687613.085538:0:5820:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000008787d6ef/0xc2ddd83e74448ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687613.085581:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576704:0@lo:501: 00000100:00100000:1.0:1788687613.085606:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687613.085835:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000114b5a15 going to sleep for 11 seconds 00000100:00100000:0.0:1788687613.085887:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839576704 00000100:00100000:0.0:1788687613.085892:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839576704 00000100:00100000:0.0:1788687613.085916:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788687613.085921:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e6b8e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5820:x1875574839576704:12345-0@lo:501: 00000100:00100000:0.0:1788687613.086252:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e6b8e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5820:x1875574839576704:12345-0@lo:501: Request processed in 331us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687613.086266:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788687613.086342:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576704:0@lo:501: 00000100:00100000:1.0:1788687613.086371:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576832:0@lo:503: 00000100:00100000:1.0:1788687613.086407:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687613.086426:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000114b5a15 going to sleep for 11 seconds 00000100:00100000:0.0:1788687613.086503:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839576832 00000100:00100000:0.0:1788687613.086508:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839576832 00000100:00100000:0.0:1788687613.086526:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788687613.086531:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088cd2432 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5820:x1875574839576832:12345-0@lo:503: 00000100:00100000:0.0:1788687613.086812:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088cd2432 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5820:x1875574839576832:12345-0@lo:503: Request processed in 280us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687613.086819:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788687613.086908:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839576832:0@lo:503: 00000100:00100000:0.0:1788687613.087343:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009310927e pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5867:1875574839576960:0@lo:502: 00000100:00100000:0.0:1788687613.087380:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687613.087412:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 0000000071e9baf7 going to sleep for 11 seconds 00000100:00100000:3.0:1788687613.087470:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839576960 00000100:00100000:3.0:1788687613.087475:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839576960 00000100:00100000:3.0:1788687613.087533:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788687613.087539:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022858da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5867:x1875574839576960:12345-0@lo:502: 00000100:00100000:3.0:1788687613.087752:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022858da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5867:x1875574839576960:12345-0@lo:502: Request processed in 213us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687613.087759:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788687613.087831:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009310927e pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5867:1875574839576960:0@lo:502: 00000020:01000004:0.0:1788687613.087880:0:5867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788687613.087892:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000f931b7a3) 00000020:00000080:0.0:1788687613.087906:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788687613.088034:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f147ea4a from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788687613.088037:0:5867:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f147ea4a from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788687613.088039:0:5867:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f147ea4a 4 00010000:00080000:0.0:1788687613.088061:0:5867:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000eb98f1ea@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1788687613.090363:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788687613.090716:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788687613.090751:0:5867:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788687613.090775:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc2ddd83e74448ad5 00000100:00080000:0.0:1788687613.090788:0:5867:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788687613.090792:0:5867:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000eb98f1ea using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788687613.090830:0:5867:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009310927e x1875574839577088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788687613.090865:0:5867:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788687613.091065:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009310927e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875574839577088:0@lo:38: 00000100:00100000:3.0:1788687613.091136:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687613.093167:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5867:1875574839577216:0@lo:502: 00000100:00100000:1.0:1788687613.093239:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687613.093274:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839577216 00000100:00100000:1.0:1788687613.093281:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839577216 00000100:00100000:1.0:1788687613.093318:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788687613.093325:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000108e9861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5867:x1875574839577216:12345-0@lo:502: 00000100:00100000:1.0:1788687613.093573:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000108e9861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5867:x1875574839577216:12345-0@lo:502: Request processed in 247us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687613.093582:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788687613.093601:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839577088 00000100:00100000:0.0:1788687613.093608:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839577088 00000100:00100000:1.0:1788687613.093695:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 0000000093b276ee going to sleep for 11 seconds 00000100:00100000:0.0:1788687613.093709:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788687613.093718:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083beef26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875574839577088:12345-0@lo:38: 00000100:00100000:1.0:1788687613.093719:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5867:1875574839577216:0@lo:502: 00000040:00080000:1.0:1788687613.093750:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1788687613.093846:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083beef26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875574839577088:12345-0@lo:38: Request processed in 127us (2709us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788687613.093853:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788687613.093922:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788687613.093931:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000eb98f1ea lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788687613.093948:0:3309:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788687613.093952:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009310927e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875574839577088:0@lo:38: 00000020:01000000:0.0:1788687613.093952:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788687613.093981:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788687613.094002:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000008787d6ef/0xc2ddd83e74448ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.094014:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000008787d6ef/0xc2ddd83e74448ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788687613.094059:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788687613.094062:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788687613.094063:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687613.094064:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687613.094065:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687613.094067:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687613.094068:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788687613.094069:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788687613.094070:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788687613.094072:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788687613.094073:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687613.094075:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788687613.094078:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788687613.094081:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788687613.094082:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788687613.094083:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687613.094095:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687613.094096:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687613.094097:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687613.094098:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788687613.094098:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788687613.094099:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788687613.094100:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788687613.094101:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687613.094102:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788687613.094117:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788687613.094126:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ee894cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839577344:0@lo:253: 00000100:00100000:0.0:1788687613.094164:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687613.094186:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c72dde27 going to sleep for 11 seconds 00000100:00100000:2.0:1788687613.096618:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839577344 00000100:00100000:2.0:1788687613.096635:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839577344 00000100:00100000:2.0:1788687613.096693:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788687613.096703:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006db33b16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5820:x1875574839577344:12345-0@lo:253: 20000000:01000000:2.0:1788687613.096735:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788687613.096751:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788687613.120603:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788687613.120625:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788687613.120676:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788687613.120681:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788687613.120701:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.120721:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c999ce8/0xc2ddd83e74448aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448aa4 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.120728:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.120773:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c999ce8/0xc2ddd83e74448aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448aa4 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.120788:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c999ce8/0xc2ddd83e74448aab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448aa4 expref: 12 pid: 5831 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687613.120803:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098f9127b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875574839577472:0@lo:104: 00000100:00100000:0.0:1788687613.120871:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687613.120929:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 0000000080fc5dd6 going to sleep for 11 seconds 00000100:00100000:2.0:1788687613.121121:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839577472 00000100:00100000:2.0:1788687613.121130:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839577472 00000100:00100000:2.0:1788687613.121185:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788687613.121193:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009564d84d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:5855:x1875574839577472:12345-0@lo:104: 00010000:00010000:2.0:1788687613.121205:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687613.121255:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788687613.121260:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009564d84d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:5855:x1875574839577472:12345-0@lo:104: Request processed in 69us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687613.121267:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788687613.121326:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687613.121345:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121352:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000debe9d81 already unused, calling callback (0000000074fe08b6) 10000000:00010000:0.0:1788687613.121355:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121362:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687613.121369:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687613.121374:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788687613.121406:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121412:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788687613.121453:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121460:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 00000000debe9d81/0xc2ddd83e74448aa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448aab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121522:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687613.121525:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687613.121526:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687613.121595:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0d12711 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839577600:0@lo:103: 00000100:00100000:0.0:1788687613.121625:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687613.121693:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839577600 00000100:00100000:0.0:1788687613.121697:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839577600 00010000:00010000:0.0:1788687613.121720:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c999ce8/0xc2ddd83e74448aab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448aa4 expref: 13 pid: 5831 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687613.121742:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788687613.121747:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041a39133 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3311:x1875574839577600:12345-0@lo:103: 00010000:00010000:0.0:1788687613.121756:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687613.121760:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c999ce8/0xc2ddd83e74448aab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448aa4 expref: 13 pid: 5831 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121768:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c999ce8/0xc2ddd83e74448aab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448aa4 expref: 13 pid: 5831 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121786:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121793:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788687613.121804:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001125140s 00010000:00010000:0.0:1788687613.121807:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121813:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121818:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121823:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121827:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001d713333 already unused, calling callback (000000000eecaf44) 00010000:00010000:0.0:1788687613.121835:0:5824:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121842:0:5824:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121849:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.121859:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687613.121886:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041a39133 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3311:x1875574839577600:12345-0@lo:103: Request processed in 139us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687613.121893:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788687613.121929:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0d12711 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839577600:0@lo:103: 00010000:00010000:0.0:1788687613.121969:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c999ce8/0xc2ddd83e74448aab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448aa4 expref: 12 pid: 5831 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687613.122754:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098f9127b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875574839577472:0@lo:104: 00010000:00010000:0.0:1788687613.122770:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.122779:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.122784:0:5855:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687613.122789:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001d713333/0xc2ddd83e74448adc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687613.131626:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006db33b16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:5820:x1875574839577344:12345-0@lo:253: Request processed in 34915us (37452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687613.131641:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788687613.132176:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ee894cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5820:1875574839577344:0@lo:253: 10000000:01000000:0.0:1788687613.132206:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788687613.132209:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788687613.132212:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788687613.132213:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687613.132214:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687613.132214:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687613.132215:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687613.132216:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788687613.132218:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788687613.132219:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788687613.132220:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788687613.132222:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687613.132223:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788687613.132241:0:5820:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788687613.141371:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687613.142771:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687613.143573:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687613.143808:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687613.144475:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687613.144768:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687613.146231:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687613.146745:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687613.147030:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687613.147695:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687613.147905:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687613.148317:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788687613.184034:0:5820:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788687613.210854:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788687613.211105:0:5872:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788687613.211109:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788687613.211313:0:5873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788687613.214422:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788687613.214634:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788687613.215052:0:5820:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788687613.215060:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788687613.215186:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788687613.216340:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788687613.216890:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788687613.216918:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788687613.217158:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788687613.217374:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788687613.227983:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788687613.228308:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788687613.228472:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788687613.228641:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788687613.228794:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788687613.228950:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788687613.229112:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788687613.229261:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788687613.229401:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788687613.229576:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788687613.231305:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788687613.231469:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788687613.231638:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788687613.231769:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788687613.231922:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788687613.232160:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788687613.232570:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788687613.232704:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788687613.232855:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788687613.233254:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788687613.234549:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788687613.234719:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788687613.234871:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788687613.235022:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788687613.235165:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788687613.235300:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788687613.235514:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788687613.235676:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788687613.235831:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788687613.235963:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788687613.236122:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788687613.236282:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788687613.236520:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788687613.261725:0:5873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788687613.294763:0:5820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788687613.294805:0:5820:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9c60166f988 00100000:10000000:1.0:1788687613.294816:0:5820:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788687613.295571:0:5820:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788687613.295587:0:5820:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788687613.295600:0:5820:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788687613.295617:0:5820:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788687613.341518:0:5873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788687613.341598:0:5873:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788687613.341602:0:5873:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788687613.446653:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687614.469789:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687615.495862:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687616.518514:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788687616.980798:0:6116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788687617.542615:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788687618.118108:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788687618.118118:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788687618.118121:0:474:0:(import.c:65:import_set_state_nolock()) 00000000eb98f1ea lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788687618.118134:0:474:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000eb98f1ea using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788687618.118156:0:474:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000098f9127b x1875574839577856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788687618.118550:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ee894cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839577728:0@lo:400: 00000100:00100000:2.0:1788687618.118623:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687618.119182:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839577728 00000100:00100000:1.0:1788687618.119199:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839577728 00000100:00100000:1.0:1788687618.119277:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788687618.119288:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f0e1ba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:3312:x1875574839577728:12345-0@lo:400: 00000100:00100000:1.0:1788687618.119415:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f0e1ba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:3312:x1875574839577728:12345-0@lo:400: Request processed in 128us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687618.119425:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788687618.119536:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ee894cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839577728:0@lo:400: 00000100:00100000:0.0:1788687618.121622:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098f9127b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875574839577856:0@lo:38: 00000100:00100000:0.0:1788687618.121713:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687618.122123:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839577856 00000100:00100000:1.0:1788687618.122156:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839577856 00000100:00100000:1.0:1788687618.122702:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788687618.122713:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d12711 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875574839577856:12345-0@lo:38: 00010000:00080000:1.0:1788687618.122755:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:1.0:1788687618.122817:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc2ddd83e74448ae3 00000004:00100000:1.0:1788687618.122892:0:5841:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788687618.123039:0:5841:0:(import.c:65:import_set_state_nolock()) 0000000088a6d222 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687618.123150:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d12711 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875574839577856:12345-0@lo:38: Request processed in 437us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687618.123160:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788687618.123553:0:3309:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000098f9127b x1875574839577856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788687628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788687618.123576:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788687618.123585:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788687618.123591:0:3309:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788687618.123594:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000eb98f1ea lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788687618.123600:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098f9127b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875574839577856:0@lo:38: 00010000:00010000:3.0:1788687618.565672:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788687619.142910:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788687619.142918:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af3e6e77800 from 3 10000000:01000000:2.0:1788687619.142923:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788687619.142972:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000007bd76d33/0xc2ddd83e74448aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687619.142983:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000007bd76d33/0xc2ddd83e74448aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687619.142993:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000007bd76d33/0xc2ddd83e74448aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687619.143016:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839577984:0@lo:101: 00000100:00100000:2.0:1788687619.143086:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687619.143150:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9f04b94 going to sleep for 11 seconds 00000100:00100000:3.0:1788687619.143266:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839577984 00000100:00100000:3.0:1788687619.143278:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839577984 00000100:00100000:3.0:1788687619.143340:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788687619.143349:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ead41551 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:5836:x1875574839577984:12345-0@lo:101: 00010000:00010000:3.0:1788687619.143363:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687619.143378:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc4dc05d/0xc2ddd83e74448af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448aea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687619.143412:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc4dc05d/0xc2ddd83e74448af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448aea expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687619.143422:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc4dc05d/0xc2ddd83e74448af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448aea expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687619.143431:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc4dc05d, rc 0) 00000100:00100000:3.0:1788687619.143515:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ead41551 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5836:x1875574839577984:12345-0@lo:101: Request processed in 167us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687619.143522:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788687619.143656:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839577984:0@lo:101: 00010000:00010000:2.0:1788687619.143673:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000007bd76d33/0xc2ddd83e74448aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687619.143702:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000007bd76d33/0xc2ddd83e74448aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687619.143766:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839578112:0@lo:256: 00000100:00100000:2.0:1788687619.143797:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687619.143824:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9f04b94 going to sleep for 11 seconds 00000100:00100000:0.0:1788687619.143912:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839578112 00000100:00100000:0.0:1788687619.143916:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839578112 00000100:00100000:0.0:1788687619.143950:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788687619.143956:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dc7bf1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5836:x1875574839578112:12345-0@lo:256: 20000000:01000000:0.0:1788687619.143978:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788687619.143993:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788687619.143997:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788687619.144080:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dc7bf1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5836:x1875574839578112:12345-0@lo:256: Request processed in 124us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687619.144086:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788687619.144190:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a18599e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839578112:0@lo:256: 10000000:01000000:2.0:1788687619.144229:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788687619.144235:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000007bd76d33/0xc2ddd83e74448aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687619.144242:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000007bd76d33/0xc2ddd83e74448aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687619.590142:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687620.619126:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788687621.221941:0:6317:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebfee4c10 20000000:00000080:1.0:1788687621.221960:0:6317:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af3fcbb7400 uarg=0000000000000000 20000000:01000000:1.0:1788687621.221996:0:6317:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788687621.222004:0:6317:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788687621.222008:0:6317:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788687621.222207:0:6317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788687621.222218:0:6317:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788687621.227875:0:6317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788687621.228225:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788687621.230983:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788687621.231075:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788687621.231099:0:6317:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788687621.231117:0:6317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687621.231135:0:6317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e0bcc02/0xc2ddd83e74448ab9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448ab2 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687621.231143:0:6317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687621.231201:0:6317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e0bcc02/0xc2ddd83e74448ab9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448ab2 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687621.231216:0:6317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e0bcc02/0xc2ddd83e74448ab9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448ab2 expref: 11 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687621.231230:0:6317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6317:1875574839578240:0@lo:104: 00000100:00100000:1.0:1788687621.233659:0:6317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687621.233735:0:6317:0:(client.c:2716:ptlrpc_set_wait()) set 00000000420d6b79 going to sleep for 11 seconds 00000100:00100000:0.0:1788687621.233829:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839578240 00000100:00100000:0.0:1788687621.233840:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839578240 00000100:00100000:0.0:1788687621.233894:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788687621.233902:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bbba02b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:6317:x1875574839578240:12345-0@lo:104: 00010000:00010000:0.0:1788687621.233919:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687621.233995:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788687621.234001:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bbba02b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:6317:x1875574839578240:12345-0@lo:104: Request processed in 100us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687621.234008:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788687621.234078:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687621.234085:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234093:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e64194a already unused, calling callback (0000000074fe08b6) 10000000:00010000:3.0:1788687621.234097:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234122:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788687621.234128:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687621.234134:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788687621.234179:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234185:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788687621.234204:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234210:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 000000002e64194a/0xc2ddd83e74448ab2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ab9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234230:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687621.234231:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687621.234232:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687621.234245:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6dea81c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839578368:0@lo:103: 00000100:00100000:3.0:1788687621.234280:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687621.234333:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839578368 00000100:00100000:3.0:1788687621.234337:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839578368 00010000:00010000:3.0:1788687621.234356:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e0bcc02/0xc2ddd83e74448ab9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448ab2 expref: 12 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687621.234378:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687621.234383:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7501d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:3313:x1875574839578368:12345-0@lo:103: 00010000:00010000:3.0:1788687621.234399:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687621.234405:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e0bcc02/0xc2ddd83e74448ab9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448ab2 expref: 12 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234415:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e0bcc02/0xc2ddd83e74448ab9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448ab2 expref: 12 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234432:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234455:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234471:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234500:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234506:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234512:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234517:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008cb62d16 already unused, calling callback (000000000eecaf44) 00010000:00010000:3.0:1788687621.234520:0:5824:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234526:0:5824:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234544:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687621.234553:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687621.234583:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7501d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:3313:x1875574839578368:12345-0@lo:103: Request processed in 201us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687621.234589:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687621.234626:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6dea81c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839578368:0@lo:103: 00010000:00010000:1.0:1788687621.236413:0:6317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e0bcc02/0xc2ddd83e74448ab9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448ab2 expref: 11 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687621.236434:0:6317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6317:1875574839578240:0@lo:104: 00010000:00010000:1.0:1788687621.236459:0:6317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687621.236468:0:6317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687621.236474:0:6317:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687621.236499:0:6317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008cb62d16/0xc2ddd83e74448af8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687621.637721:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687622.663788:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687623.243169:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839578496:0@lo:400: 00000100:00100000:0.0:1788687623.243260:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687623.243432:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000004842ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839578624:0@lo:400: 00000100:00100000:1.0:1788687623.243471:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687623.247945:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839578496 00000100:00100000:2.0:1788687623.247963:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839578496 00000100:00100000:2.0:1788687623.248030:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788687623.248039:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000254b155e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:3310:x1875574839578496:12345-0@lo:400: 00000100:00100000:2.0:1788687623.248132:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000254b155e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:3310:x1875574839578496:12345-0@lo:400: Request processed in 94us (4872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687623.248139:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788687623.248213:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c411900c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839578496:0@lo:400: 00000100:00100000:1.0:1788687623.248470:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839578624 00000100:00100000:1.0:1788687623.248476:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839578624 00000100:00100000:1.0:1788687623.248550:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788687623.248557:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054d8502c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839578624:12345-0@lo:400: 00000100:00100000:1.0:1788687623.248605:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054d8502c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839578624:12345-0@lo:400: Request processed in 49us (5134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687623.248611:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788687623.248769:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000004842ac x1875574839578624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687623.248783:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000004842ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839578624:0@lo:400: 00010000:00010000:3.0:1788687623.685872:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687624.713596:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687625.733892:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788687625.798140:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788687625.798148:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3e6e77800 from 1 10000000:01000000:1.0:1788687625.798153:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687625.798206:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000ac3e563d/0xc2ddd83e74448aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687625.798218:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000ac3e563d/0xc2ddd83e74448aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687625.798228:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000ac3e563d/0xc2ddd83e74448aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687625.798255:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e6d6a613 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839578752:0@lo:101: 00000100:00100000:1.0:1788687625.798326:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687625.798375:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 000000000513fbca going to sleep for 11 seconds 00000100:00100000:3.0:1788687625.798406:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839578752 00000100:00100000:3.0:1788687625.798414:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839578752 00000100:00100000:3.0:1788687625.798466:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788687625.798474:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9aab281 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:5836:x1875574839578752:12345-0@lo:101: 00010000:00010000:3.0:1788687625.798502:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687625.798515:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b0a2d694/0xc2ddd83e74448b06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448aff expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687625.798535:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b0a2d694/0xc2ddd83e74448b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448aff expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687625.798544:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b0a2d694/0xc2ddd83e74448b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448aff expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687625.798552:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b0a2d694, rc 0) 00000100:00100000:3.0:1788687625.798585:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9aab281 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5836:x1875574839578752:12345-0@lo:101: Request processed in 112us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687625.798597:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788687625.798921:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e6d6a613 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839578752:0@lo:101: 00010000:00010000:1.0:1788687625.798935:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000ac3e563d/0xc2ddd83e74448aff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687625.798942:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000ac3e563d/0xc2ddd83e74448aff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687625.798997:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e6d6a613 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839578880:0@lo:501: 00000100:00100000:1.0:1788687625.799023:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687625.799056:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 000000000513fbca going to sleep for 11 seconds 00000100:00100000:1.0:1788687625.799069:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839578880 00000100:00100000:1.0:1788687625.799073:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839578880 00000100:00100000:1.0:1788687625.799093:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788687625.799099:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d393c957 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5836:x1875574839578880:12345-0@lo:501: 00000100:00100000:3.0:1788687625.799428:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e6d6a613 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839578880:0@lo:501: 00000100:00100000:3.0:1788687625.799457:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6dea81c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839579008:0@lo:503: 00000100:00100000:3.0:1788687625.799512:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687625.799532:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b795193e going to sleep for 11 seconds 00000100:00100000:3.0:1788687625.799543:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839579008 00000100:00100000:3.0:1788687625.799547:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839579008 00000100:00100000:3.0:1788687625.799562:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788687625.799568:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a61645c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839579008:12345-0@lo:503: 00000100:00100000:3.0:1788687625.801029:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a61645c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839579008:12345-0@lo:503: Request processed in 1453us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687625.801042:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788687625.801383:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d393c957 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5836:x1875574839578880:12345-0@lo:501: Request processed in 2282us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687625.801392:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788687625.803331:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6dea81c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839579008:0@lo:503: 00000100:00100000:0.0:1788687625.810136:0:6644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098f9127b pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6644:1875574839579136:0@lo:502: 00000100:00100000:0.0:1788687625.810237:0:6644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687625.810289:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839579136 00000100:00100000:0.0:1788687625.810298:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839579136 00000100:00100000:0.0:1788687625.810346:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788687625.810355:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f72ef07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6644:x1875574839579136:12345-0@lo:502: 00000100:00100000:0.0:1788687625.811241:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f72ef07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6644:x1875574839579136:12345-0@lo:502: Request processed in 885us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687625.811250:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788687625.811315:0:6644:0:(client.c:2716:ptlrpc_set_wait()) set 0000000015331565 going to sleep for 11 seconds 00000100:00100000:0.0:1788687625.811340:0:6644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098f9127b pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6644:1875574839579136:0@lo:502: 00000020:01000000:0.0:1788687625.811372:0:6644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687625.812334:0:6644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687625.812341:0:6644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788687625.812354:0:6644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af3e6e77800 00000020:00000080:0.0:1788687625.812357:0:6644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788687625.812499:0:6644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6644:1875574839579264:0@lo:502: 00000100:00100000:0.0:1788687625.812560:0:6644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687625.812707:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839579264 00000100:00100000:1.0:1788687625.812714:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839579264 00000100:00100000:1.0:1788687625.812757:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788687625.812767:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6644:x1875574839579264:12345-0@lo:502: 00000100:00100000:0.0:1788687625.812811:0:6644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f39d6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788687625.813028:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6644:x1875574839579264:12345-0@lo:502: Request processed in 261us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687625.813035:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788687625.813101:0:6644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6644:1875574839579264:0@lo:502: 00000020:01000000:0.0:1788687625.813129:0:6644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687625.813136:0:6644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687625.813138:0:6644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788687625.813144:0:6644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788687625.813261:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788687625.813287:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788687625.813298:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed800/0xc2ddd83e74448aff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687625.813311:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed800/0xc2ddd83e74448aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687626.757638:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788687626.951539:0:6684:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788687626.951543:0:6684:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788687626.951770:0:6684:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9af3f39f5000 00000020:01000004:1.0:1788687626.951786:0:6684:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788687626.951797:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788687626.951811:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9af3e0234d40) 00000020:00000080:1.0:1788687626.951832:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788687626.964158:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788687626.964427:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788687626.982061:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788687626.986808:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788687626.986844:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788687626.986901:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788687626.986943:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788687626.987298:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788687626.987309:0:6684:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788687626.987319:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc2ddd83e74448b14 00000020:01000004:3.0:1788687626.987326:0:6684:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788687626.987346:0:6684:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788687626.987354:0:6684:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788687626.987360:0:6684:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788687626.987365:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788687626.987375:0:6684:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9af3c2ebb380) 00000020:00000080:3.0:1788687626.987385:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788687626.988477:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687626.988665:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788687626.988671:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788687626.989298:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788687626.989305:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788687626.993070:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788687626.993081:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788687627.000616:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788687627.000811:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788687627.000818:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788687627.002836:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788687627.002848:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788687627.033944:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788687627.034388:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788687627.034396:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788687627.036513:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788687627.036526:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788687627.037985:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788687627.038001:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788687627.041473:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687627.042004:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788687627.042011:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788687627.042964:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788687627.042973:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788687627.126872:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687627.127138:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788687627.127146:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788687627.128899:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788687627.128912:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788687627.130071:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788687627.130165:0:6684:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788687627.130182:0:6684:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788687627.178396:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788687627.178441:0:6684:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788687627.178445:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788687627.178447:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788687627.178578:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788687627.178579:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788687627.178580:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788687627.178582:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788687627.178583:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788687627.178585:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788687627.178586:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788687627.178587:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788687627.178588:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788687627.178592:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788687627.178595:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788687627.178596:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788687627.178597:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788687627.178598:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788687627.178599:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788687627.178600:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788687627.178601:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788687627.178602:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788687627.178609:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788687627.178610:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788687627.178611:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788687627.178638:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788687627.178657:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839579392:0@lo:253: 00000100:00100000:1.0:1788687627.178821:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687627.178953:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c684d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788687627.183305:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839579392 00000100:00100000:2.0:1788687627.183320:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839579392 00000100:00100000:2.0:1788687627.183465:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788687627.183477:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839579392:12345-0@lo:253: 20000000:01000000:2.0:1788687627.183565:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788687627.183569:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788687627.183575:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788687627.183578:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788687627.184571:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788687627.184792:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788687627.184806:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788687627.184844:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788687627.184851:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788687627.184880:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788687627.184937:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788687627.185303:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788687627.185322:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:2.0:1788687627.185323:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788687627.185358:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788687627.185366:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788687627.185425:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788687627.185433:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:2.0:1788687627.185463:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788687627.185471:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788687627.185554:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788687627.185604:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788687627.197635:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788687627.197680:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:2.0:1788687627.197683:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788687627.197745:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788687627.197753:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788687627.197781:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788687627.197788:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:2.0:1788687627.197833:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788687627.197842:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788687627.197873:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788687627.197905:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788687627.197922:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788687627.197924:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788687627.197930:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788687627.197932:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788687627.197934:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788687627.197946:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788687627.197948:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788687627.197980:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788687627.197983:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788687627.199144:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788687627.199229:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788687627.199287:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788687627.199796:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788687627.199834:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788687627.199889:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788687627.199901:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788687627.199903:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788687627.201721:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788687627.202099:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788687627.202145:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788687627.202229:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788687627.202244:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788687627.202247:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788687627.203220:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788687627.203279:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788687627.203331:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788687627.203637:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788687627.203700:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788687627.203738:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:2.0:1788687627.203757:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788687627.203777:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.203795:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448a34 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.203814:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c0030000/0xc2ddd83e74448a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448a50 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.203822:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aadc00/0xc2ddd83e74448ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448ac0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.203829:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.203869:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aadc00/0xc2ddd83e74448ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448ac0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.203883:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3e0aadc00/0xc2ddd83e74448ac7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448ac0 expref: 12 pid: 5833 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687627.203898:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1875574839579520:0@lo:104: 00000100:00100000:2.0:1788687627.203965:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788687627.204021:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c0030000/0xc2ddd83e74448a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448a50 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.204030:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c0030000/0xc2ddd83e74448a57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448a50 expref: 12 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687627.204040:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1875574839579648:0@lo:104: 00000100:00100000:2.0:1788687627.204062:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788687627.204099:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448a34 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.204107:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448a34 expref: 12 pid: 5833 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687627.204121:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1875574839579776:0@lo:104: 00000100:00100000:2.0:1788687627.204144:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687627.204153:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8625780 going to sleep for 11 seconds 00000100:00100000:0.0:1788687627.204312:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839579520 00000100:00100000:0.0:1788687627.204320:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839579520 00000100:00100000:0.0:1788687627.204357:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839579648 00000100:00100000:0.0:1788687627.204360:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839579648 00000100:00100000:0.0:1788687627.204379:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839579776 00000100:00100000:0.0:1788687627.204382:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839579776 00000100:00100000:0.0:1788687627.204395:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788687627.204404:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:5833:x1875574839579520:12345-0@lo:104: 00010000:00010000:0.0:1788687627.204416:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c13ede00/0xc2ddd83e74448ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204500:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788687627.204507:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:5833:x1875574839579520:12345-0@lo:104: Request processed in 104us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687627.204514:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788687627.204531:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788687627.204537:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:5833:x1875574839579648:12345-0@lo:104: 00010000:00010000:0.0:1788687627.204546:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204579:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788687627.204584:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:5833:x1875574839579648:12345-0@lo:104: Request processed in 48us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687627.204590:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788687627.204600:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788687627.204606:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:5833:x1875574839579776:12345-0@lo:104: 00010000:00010000:0.0:1788687627.204613:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af4021d9600/0xc2ddd83e74448a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204639:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788687627.204646:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:5833:x1875574839579776:12345-0@lo:104: Request processed in 41us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687627.204664:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788687627.204679:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788687627.204685:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c13ede00/0xc2ddd83e74448ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204706:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ede00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687627.204710:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ede00/0xc2ddd83e74448ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204720:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c13ede00/0xc2ddd83e74448ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687627.204726:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ede00/0xc2ddd83e74448ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687627.204732:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788687627.204771:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c13ede00/0xc2ddd83e74448ac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204779:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788687627.204798:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ede00/0xc2ddd83e74448ac0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204805:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c13ede00/0xc2ddd83e74448ac0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ac7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204821:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788687627.204824:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204840:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8000 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687627.204842:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204849:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687627.204856:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687627.204862:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788687627.204875:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448a50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204881:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788687627.204887:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448a50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204894:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448a57 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204904:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687627.204907:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af4021d9600/0xc2ddd83e74448a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204913:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9600 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687627.204916:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d9600/0xc2ddd83e74448a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204932:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af4021d9600/0xc2ddd83e74448a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687627.204939:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d9600/0xc2ddd83e74448a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687627.204945:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788687627.204958:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af4021d9600/0xc2ddd83e74448a34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204964:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788687627.204976:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af4021d9600/0xc2ddd83e74448a34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204983:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af4021d9600/0xc2ddd83e74448a34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448a3b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.204998:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687627.205000:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687627.205001:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687627.205009:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788687627.205020:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839580160:0@lo:103: 00000100:00100000:0.0:1788687627.205048:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687627.205082:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839580160 00000100:00100000:0.0:1788687627.205086:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839580160 00010000:00010000:0.0:1788687627.205103:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448a3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448a34 expref: 13 pid: 5833 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687627.205121:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788687627.205127:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3311:x1875574839580160:12345-0@lo:103: 00010000:00010000:0.0:1788687627.205141:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687627.205147:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448a3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448a34 expref: 13 pid: 5833 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.205157:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448a34 expref: 13 pid: 5833 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.205184:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687627.205211:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3311:x1875574839580160:12345-0@lo:103: Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687627.205218:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788687627.205260:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839580160:0@lo:103: 00000100:00100000:2.0:1788687627.205476:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1875574839579520:0@lo:104: 00000100:00100000:2.0:1788687627.205508:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1875574839579648:0@lo:104: 00010000:00010000:2.0:1788687627.205515:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448a3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448a34 expref: 12 pid: 5833 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687627.205525:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1875574839579776:0@lo:104: 00010000:00010000:2.0:1788687627.205543:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687627.205694:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839579904:0@lo:103: 00000100:00100000:3.0:1788687627.205726:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687627.205749:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788687627.205753:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839580032:0@lo:103: 00000100:00100000:3.0:1788687627.205770:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687627.205801:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839579904 00000100:00100000:3.0:1788687627.205805:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839579904 00010000:00010000:3.0:1788687627.205822:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aadc00/0xc2ddd83e74448ac7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448ac0 expref: 12 pid: 5833 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687627.205836:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839580032 00000100:00100000:3.0:1788687627.205838:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839580032 00010000:00010000:3.0:1788687627.205862:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c0030000/0xc2ddd83e74448a57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448a50 expref: 13 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687627.205889:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788687627.205896:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3312:x1875574839579904:12345-0@lo:103: 00010000:00010000:3.0:1788687627.205905:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687627.205909:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aadc00/0xc2ddd83e74448ac7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448ac0 expref: 13 pid: 5833 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.205913:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687627.205918:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aadc00/0xc2ddd83e74448ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448ac0 expref: 13 pid: 5833 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.205929:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aadc00/0xc2ddd83e74448ac7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448ac0 expref: 13 pid: 5833 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.205937:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687627.205972:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:3312:x1875574839579904:12345-0@lo:103: Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687627.205979:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788687627.205992:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788687627.206000:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:3312:x1875574839580032:12345-0@lo:103: 00010000:00010000:0.0:1788687627.206010:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687627.206015:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c0030000/0xc2ddd83e74448a57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448a50 expref: 11 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206024:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c0030000/0xc2ddd83e74448a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448a50 expref: 11 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206034:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c0030000/0xc2ddd83e74448a57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448a50 expref: 11 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206045:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206053:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206088:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206095:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206102:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206108:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206113:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687627.206118:0:5825:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206125:0:5825:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206149:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.206158:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687627.206192:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:3312:x1875574839580032:12345-0@lo:103: Request processed in 193us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687627.206198:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788687627.206341:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839580032:0@lo:103: 00000100:00100000:2.0:1788687627.206352:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839579904:0@lo:103: 00010000:00010000:3.0:1788687627.206363:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.206371:0:5833:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.206378:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788687627.206391:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788687627.281794:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:6684:x1875574839579392:12345-0@lo:253: Request processed in 98309us (102962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687627.281811:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788687627.282066:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839579392:0@lo:253: 10000000:01000000:3.0:1788687627.282083:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788687627.282103:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788687627.282105:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788687627.282106:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788687627.282107:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788687627.282109:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788687627.282110:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788687627.282112:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788687627.282114:0:6684:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788687627.282115:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788687627.282117:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788687627.282140:0:6684:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9af3f39f5000 from lustre-OST0000 10000000:01000000:3.0:1788687627.282179:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788687627.282182:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788687627.282188:0:6684:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9af3e0230000 local copy 10000000:01000000:3.0:1788687627.282193:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788687627.282235:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.282247:0:6684:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.282257:0:6684:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687627.282275:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839580288:0@lo:101: 00000100:00100000:3.0:1788687627.282315:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687627.282373:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788687627.282617:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839580288 00000100:00100000:1.0:1788687627.282624:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839580288 00000100:00100000:1.0:1788687627.282721:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788687627.282731:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:6684:x1875574839580288:12345-0@lo:101: 00010000:00010000:1.0:1788687627.282744:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687627.282759:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448b29 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.282784:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448b29 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.282796:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448b29 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.282815:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ecc00, rc 0) 00000100:00100000:1.0:1788687627.282859:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:6684:x1875574839580288:12345-0@lo:101: Request processed in 129us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687627.282865:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788687627.282954:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839580288:0@lo:101: 00010000:00010000:3.0:1788687627.282968:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.282977:0:6684:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687627.283093:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839580416:0@lo:501: 00000100:00100000:3.0:1788687627.283121:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687627.283397:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788687627.283467:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839580416 00000100:00100000:2.0:1788687627.283507:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839580416 00000100:00100000:2.0:1788687627.283534:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788687627.283540:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:6684:x1875574839580416:12345-0@lo:501: 00000100:00100000:2.0:1788687627.284049:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:6684:x1875574839580416:12345-0@lo:501: Request processed in 507us (926us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788687627.284057:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788687627.284263:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839580416:0@lo:501: 10000000:01000000:3.0:1788687627.284282:0:6684:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788687627.284313:0:6684:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788687627.284320:0:6684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.284330:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.284336:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.284361:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788687627.284385:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9af3f39f5000 10000000:01000000:3.0:1788687627.284390:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788687627.284395:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9af3e0230000 10000000:01000000:3.0:1788687627.284398:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788687627.284401:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9af3e0230000 from 1 10000000:01000000:3.0:1788687627.284404:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788687627.284430:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad000/0xc2ddd83e74448b37 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.284437:0:6684:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad000/0xc2ddd83e74448b37 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.284457:0:6684:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad000/0xc2ddd83e74448b37 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687627.284560:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839580544:0@lo:101: 00000100:00100000:3.0:1788687627.284593:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687627.284624:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687627.284754:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839580544 00000100:00100000:2.0:1788687627.284760:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839580544 00000100:00100000:2.0:1788687627.284801:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788687627.284808:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:6684:x1875574839580544:12345-0@lo:101: 00010000:00010000:2.0:1788687627.284826:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687627.284841:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d9600/0xc2ddd83e74448b3e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.284862:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d9600/0xc2ddd83e74448b3e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448b37 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.284870:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d9600/0xc2ddd83e74448b3e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448b37 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.284879:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d9600, rc 0) 00000100:00100000:2.0:1788687627.284909:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839580544:12345-0@lo:101: Request processed in 101us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687627.284915:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788687627.284982:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687627.284989:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.284997:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aadc00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:1.0:1788687627.285000:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.285009:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788687627.285017:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687627.285022:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788687627.285042:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.285048:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788687627.285075:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.285083:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448b29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2ddd83e74448b30 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.285110:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687627.285112:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687627.285114:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687627.285122:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788687627.285133:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839580672:0@lo:103: 00000100:00100000:1.0:1788687627.285163:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687627.285210:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839580672 00000100:00100000:1.0:1788687627.285214:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839580672 00000100:00100000:1.0:1788687627.285246:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788687627.285253:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:3310:x1875574839580672:12345-0@lo:103: 00010000:00010000:1.0:1788687627.285263:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687627.285275:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448b29 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.285286:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687627.285312:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:3310:x1875574839580672:12345-0@lo:103: Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687627.285318:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788687627.285357:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839580672:0@lo:103: 00000100:00100000:3.0:1788687627.285470:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839580544:0@lo:101: 00010000:00010000:3.0:1788687627.285649:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad000/0xc2ddd83e74448b37 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b3e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.285659:0:6684:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad000/0xc2ddd83e74448b37 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448b3e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687627.285818:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788687627.285835:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad000/0xc2ddd83e74448b37 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b3e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.285843:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad000/0xc2ddd83e74448b37 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b3e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687627.285850:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788687627.285855:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788687627.285861:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788687627.285863:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788687627.285882:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.285889:0:6684:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.285905:0:6684:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687627.285920:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839580800:0@lo:101: 00000100:00100000:3.0:1788687627.285948:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687627.285977:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687627.286035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839580800 00000100:00100000:2.0:1788687627.286040:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839580800 00000100:00100000:2.0:1788687627.286071:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788687627.286079:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+10:6684:x1875574839580800:12345-0@lo:101: 00010000:00010000:2.0:1788687627.286088:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687627.286098:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d8000/0xc2ddd83e74448b4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.286113:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d8000/0xc2ddd83e74448b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448b45 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.286122:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d8000/0xc2ddd83e74448b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448b45 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.286129:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d8000, rc 0) 00000100:00100000:2.0:1788687627.286174:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839580800:12345-0@lo:101: Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687627.286180:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788687627.286256:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839580800:0@lo:101: 00010000:00010000:3.0:1788687627.286267:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.286275:0:6684:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687627.286355:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839580928:0@lo:501: 00000100:00100000:3.0:1788687627.286377:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687627.286439:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687627.286611:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839580928 00000100:00100000:0.0:1788687627.286616:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839580928 00000100:00100000:3.0:1788687627.286755:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788687627.286765:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839580928:12345-0@lo:501: 00000100:00100000:3.0:1788687627.289996:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839580928:12345-0@lo:501: Request processed in 3222us (3606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687627.290010:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788687627.290583:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839580928:0@lo:501: 00000100:00100000:1.0:1788687627.290646:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581056:0@lo:503: 00000100:00100000:1.0:1788687627.290836:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687627.290917:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c991ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687627.290959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839581056 00000100:00100000:3.0:1788687627.290966:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839581056 00000100:00100000:3.0:1788687627.291046:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788687627.291055:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839581056:12345-0@lo:503: 00000100:00100000:3.0:1788687627.291314:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839581056:12345-0@lo:503: Request processed in 259us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687627.291329:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788687627.291418:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581056:0@lo:503: 00000040:00080000:1.0:1788687627.291965:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788687627.292036:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581184:0@lo:502: 00000100:00100000:1.0:1788687627.292083:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687627.292120:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c7283d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788687627.292311:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839581184 00000100:00100000:2.0:1788687627.292317:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839581184 00000100:00100000:2.0:1788687627.292395:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788687627.292405:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839581184:12345-0@lo:502: 00000100:00100000:2.0:1788687627.292611:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839581184:12345-0@lo:502: Request processed in 207us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687627.292618:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788687627.292828:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581184:0@lo:502: 00000040:00080000:1.0:1788687627.293105:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788687627.293156:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788687627.293205:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788687627.293256:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788687627.293294:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788687627.293329:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788687627.293357:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581312:0@lo:502: 00000100:00100000:1.0:1788687627.293400:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687627.293519:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c7283d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788687627.293649:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839581312 00000100:00100000:3.0:1788687627.293654:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839581312 00000100:00100000:2.0:1788687627.294003:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788687627.294012:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839581312:12345-0@lo:502: 00000100:00100000:2.0:1788687627.294204:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839581312:12345-0@lo:502: Request processed in 192us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687627.294210:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788687627.294299:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581312:0@lo:502: 00000040:00080000:1.0:1788687627.294408:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788687627.294418:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788687627.295272:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788687627.295281:0:6703:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788687627.295288:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687627.295290:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788687627.295295:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788687627.295311:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9af3e0233380) 00000020:00000080:1.0:1788687627.295330:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788687627.295337:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788687627.295408:0:6703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af3f39f5000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788687627.295416:0:6703:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788687627.295423:0:6703:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc2ddd83e74448b5a 00010000:00010000:1.0:1788687627.303187:0:6703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788687627.304978:0:6703:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788687627.307988:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788687627.308979:0:6703:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788687627.319628:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788687627.320201:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788687627.327656:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788687627.332103:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687627.332116:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687627.332119:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788687627.332123:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687627.332129:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687627.332130:0:6703:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788687627.332134:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788687627.332137:0:6703:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788687627.332211:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687627.332216:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687627.332218:0:6703:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788687627.332221:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788687627.332297:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788687627.332321:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788687627.332336:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.332349:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687627.332357:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3f39f5000 from 1 10000000:01000000:3.0:1788687627.332360:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788687627.332399:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.332407:0:6684:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.332432:0:6684:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687627.332458:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581440:0@lo:101: 00000100:00100000:3.0:1788687627.332556:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687627.332605:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce180 going to sleep for 11 seconds 00000100:00100000:2.0:1788687627.335765:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839581440 00000100:00100000:2.0:1788687627.335783:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839581440 00000100:00100000:2.0:1788687627.335843:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788687627.335854:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:6684:x1875574839581440:12345-0@lo:101: 00010000:00010000:2.0:1788687627.335874:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687627.335900:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448b61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.335930:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448b61 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.335955:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448b61 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687627.335965:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d8200, rc 0) 00000100:00100000:2.0:1788687627.336046:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839581440:12345-0@lo:101: Request processed in 194us (3491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687627.336052:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788687627.336794:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581440:0@lo:101: 00010000:00010000:1.0:1788687627.336815:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.336825:0:6684:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687627.336956:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581568:0@lo:501: 00000100:00100000:1.0:1788687627.336992:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687627.337790:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c7283000 going to sleep for 11 seconds 00000100:00100000:2.0:1788687627.341647:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839581568 00000100:00100000:2.0:1788687627.341724:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839581568 00000100:00100000:2.0:1788687627.341798:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788687627.341809:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839581568:12345-0@lo:501: 00000100:00100000:2.0:1788687627.342344:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839581568:12345-0@lo:501: Request processed in 536us (5349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687627.342352:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788687627.342964:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581568:0@lo:501: 00000100:00100000:2.0:1788687627.343094:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581696:0@lo:503: 00000100:00100000:2.0:1788687627.343144:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687627.343229:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8257c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788687627.343266:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839581696 00000100:00100000:0.0:1788687627.343272:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839581696 00000100:00100000:0.0:1788687627.343351:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788687627.343360:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839581696:12345-0@lo:503: 00000100:00100000:0.0:1788687627.343888:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839581696:12345-0@lo:503: Request processed in 527us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687627.343896:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788687627.343969:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581696:0@lo:503: 00000040:00080000:2.0:1788687627.344274:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788687627.344354:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581824:0@lo:502: 00000100:00100000:2.0:1788687627.344392:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687627.344873:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8257c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788687627.344946:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839581824 00000100:00100000:3.0:1788687627.344952:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839581824 00000100:00100000:3.0:1788687627.344986:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788687627.344995:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839581824:12345-0@lo:502: 00000100:00100000:3.0:1788687627.345213:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839581824:12345-0@lo:502: Request processed in 218us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687627.345219:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788687627.345307:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581824:0@lo:502: 00000040:00080000:2.0:1788687627.345604:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788687627.345651:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788687627.345842:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581952:0@lo:502: 00000100:00100000:2.0:1788687627.345882:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687627.345909:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8257c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788687627.345969:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839581952 00000100:00100000:3.0:1788687627.345975:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839581952 00000100:00100000:3.0:1788687627.346002:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788687627.346009:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839581952:12345-0@lo:502: 00000100:00100000:3.0:1788687627.346147:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839581952:12345-0@lo:502: Request processed in 137us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687627.346154:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788687627.346244:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839581952:0@lo:502: 00000040:00080000:2.0:1788687627.346324:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788687627.346333:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788687627.347341:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788687627.347352:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687627.347354:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788687627.347360:0:6707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af3f39f5000 00000020:00000080:2.0:1788687627.347363:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788687627.347381:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788687627.347384:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687627.347386:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788687627.347388:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788687627.347603:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788687627.347626:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788687627.347649:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.347660:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687627.347801:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788687627.347804:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9af3f39f5000 10000000:01000000:0.0:1788687627.347806:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9af3f39f5000 10000000:01000000:0.0:1788687627.347810:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788687627.347815:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3f39f5000 from 1 10000000:01000000:0.0:1788687627.347818:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788687627.347848:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.347857:0:6684:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.347867:0:6684:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687627.347889:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582080:0@lo:101: 00000100:00100000:0.0:1788687627.347939:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687627.347997:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fcdb3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788687627.348047:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839582080 00000100:00100000:1.0:1788687627.348053:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839582080 00000100:00100000:1.0:1788687627.348097:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788687627.348105:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839582080:12345-0@lo:101: 00010000:00010000:1.0:1788687627.348116:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687627.348128:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.348152:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448b6f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.348163:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448b6f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.348182:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ecc00, rc 0) 00000100:00100000:1.0:1788687627.348218:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:6684:x1875574839582080:12345-0@lo:101: Request processed in 113us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687627.348231:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788687627.348398:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582080:0@lo:101: 00010000:00010000:0.0:1788687627.348411:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.348420:0:6684:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687627.348738:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582208:0@lo:501: 00000100:00100000:0.0:1788687627.348768:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687627.348796:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fcdb3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788687627.348844:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839582208 00000100:00100000:1.0:1788687627.348849:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839582208 00000100:00100000:1.0:1788687627.348880:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788687627.348887:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:6684:x1875574839582208:12345-0@lo:501: 00000100:00100000:1.0:1788687627.349107:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:6684:x1875574839582208:12345-0@lo:501: Request processed in 220us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687627.349114:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788687627.349189:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e89880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582208:0@lo:501: 00000100:00100000:2.0:1788687627.349215:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582336:0@lo:503: 00000100:00100000:2.0:1788687627.349251:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687627.349273:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8257c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687627.349311:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839582336 00000100:00100000:1.0:1788687627.349315:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839582336 00000100:00100000:1.0:1788687627.349333:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788687627.349340:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:6684:x1875574839582336:12345-0@lo:503: 00000100:00100000:1.0:1788687627.349521:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:6684:x1875574839582336:12345-0@lo:503: Request processed in 181us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687627.349528:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788687627.349677:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582336:0@lo:503: 00000040:00080000:2.0:1788687627.349932:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788687627.349999:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582464:0@lo:502: 00000100:00100000:2.0:1788687627.350034:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687627.350063:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8257c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687627.350182:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839582464 00000100:00100000:1.0:1788687627.350187:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839582464 00000100:00100000:1.0:1788687627.350207:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788687627.350213:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:6684:x1875574839582464:12345-0@lo:502: 00000100:00100000:1.0:1788687627.350376:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:6684:x1875574839582464:12345-0@lo:502: Request processed in 162us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687627.350382:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788687627.350589:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582464:0@lo:502: 00000040:00080000:2.0:1788687627.350908:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788687627.350958:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788687627.351000:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788687627.351047:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788687627.351083:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788687627.351142:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788687627.351196:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788687627.351233:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788687627.351281:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788687627.351317:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788687627.351351:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788687627.351400:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788687627.351437:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788687627.353038:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788687627.353173:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788687627.353237:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788687627.353269:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788687627.353315:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788687627.353348:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788687627.353378:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788687627.353422:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788687627.353454:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788687627.353725:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788687627.353786:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788687627.353822:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788687627.353854:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788687627.353919:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788687627.353959:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788687627.354013:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582592:0@lo:502: 00000100:00100000:2.0:1788687627.354100:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687627.354219:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8257c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788687627.354520:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839582592 00000100:00100000:3.0:1788687627.354529:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839582592 00000100:00100000:1.0:1788687627.356960:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788687627.356987:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:6684:x1875574839582592:12345-0@lo:502: 00000100:00100000:1.0:1788687627.357352:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:6684:x1875574839582592:12345-0@lo:502: Request processed in 379us (3250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687627.357371:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788687627.358354:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582592:0@lo:502: 00000040:00080000:2.0:1788687627.358774:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788687627.358800:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788687627.359266:0:6708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788687627.359280:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9af3e02319c0) 00000020:00000080:1.0:1788687627.359298:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788687627.359357:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af3f39f5000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788687627.359360:0:6708:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af3f39f5000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788687627.359362:0:6708:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3f39f5000 3 00010000:00080000:1.0:1788687627.359386:0:6708:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af3f7b75000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788687627.364061:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788687627.364412:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788687627.364449:0:6708:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788687627.364476:0:6708:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc2ddd83e74448b84 00000100:00080000:1.0:1788687627.364520:0:6708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788687627.364527:0:6708:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9af3f7b75000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788687627.364565:0:6708:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3c5b65500 x1875574839582720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788687627.364583:0:6708:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788687627.364860:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839582848:0@lo:400: 00000100:00100000:2.0:1788687627.364938:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687627.365062:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875574839582720:0@lo:38: 00000100:00100000:0.0:1788687627.365096:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687627.365139:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839582848 00000100:00100000:0.0:1788687627.365146:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839582848 00000100:00100000:0.0:1788687627.365195:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839582720 00000100:00100000:0.0:1788687627.365198:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839582720 00000100:00100000:0.0:1788687627.365213:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788687627.365222:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839582848:12345-0@lo:400: 00000100:00100000:0.0:1788687627.365275:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839582848:12345-0@lo:400: Request processed in 53us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687627.365283:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788687627.365297:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788687627.365301:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875574839582720:12345-0@lo:38: 00010000:00080000:0.0:1788687627.365324:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1788687627.365353:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc2ddd83e74448b8b 00000004:00100000:0.0:1788687627.365368:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788687627.365416:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9af3f589b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788687627.365456:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875574839582720:12345-0@lo:38: Request processed in 153us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687627.365464:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788687627.365537:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9af3f40bb800 x1875574839582848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687627.365552:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839582848:0@lo:400: 00010000:00080000:0.0:1788687627.365595:0:3309:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9af3c5b65500 x1875574839582720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788687637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687627.365603:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788687627.365610:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788687627.365617:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788687627.365622:0:3309:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788687627.365624:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f7b75000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788687627.365629:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875574839582720:0@lo:38: 00000040:00080000:2.0:1788687627.368011:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788687627.369010:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788687627.369045:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788687627.369103:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.369117:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788687627.369188:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788687627.369190:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788687627.369191:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687627.369192:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687627.369197:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687627.369199:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687627.369200:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788687627.369201:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788687627.369202:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788687627.369204:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687627.369205:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788687627.369208:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788687627.369211:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788687627.369212:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788687627.369213:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687627.369214:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687627.369215:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687627.369216:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687627.369217:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788687627.369218:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788687627.369219:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788687627.369220:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687627.369221:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788687627.369247:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788687627.369266:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582976:0@lo:253: 00000100:00100000:0.0:1788687627.369336:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687627.369383:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fcdb3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687627.370601:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839582976 00000100:00100000:3.0:1788687627.370610:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839582976 00000100:00100000:3.0:1788687627.370744:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788687627.370755:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:6684:x1875574839582976:12345-0@lo:253: 20000000:01000000:3.0:1788687627.370784:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788687627.370805:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788687627.413761:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788687627.413810:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788687627.414742:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788687627.414749:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788687627.414772:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.414791:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448aea expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.414799:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.414842:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448aea expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687627.414873:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448aea expref: 13 pid: 5831 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687627.414888:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875574839583104:0@lo:104: 00000100:00100000:0.0:1788687627.414964:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687627.415056:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6e17300 going to sleep for 11 seconds 00000100:00100000:3.0:1788687627.419868:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839583104 00000100:00100000:3.0:1788687627.419887:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839583104 00000100:00100000:3.0:1788687627.419965:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788687627.419977:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:5855:x1875574839583104:12345-0@lo:104: 00010000:00010000:3.0:1788687627.419997:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af4021d9c00/0xc2ddd83e74448aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687627.420098:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788687627.420106:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:5855:x1875574839583104:12345-0@lo:104: Request processed in 131us (5141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687627.420112:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788687627.420455:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875574839583104:0@lo:104: 00010000:00010000:0.0:1788687627.420628:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.421256:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687627.421267:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af4021d9c00/0xc2ddd83e74448aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.421275:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9c00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:1.0:1788687627.421280:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d9c00/0xc2ddd83e74448aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.421289:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af4021d9c00/0xc2ddd83e74448aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788687627.421320:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d9c00/0xc2ddd83e74448aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687627.421326:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788687627.421382:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af4021d9c00/0xc2ddd83e74448aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.421389:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788687627.421417:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af4021d9c00/0xc2ddd83e74448aea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.421425:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af4021d9c00/0xc2ddd83e74448aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448af1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.421444:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687627.421446:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687627.421448:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687627.421457:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788687627.421517:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839583232:0@lo:103: 00000100:00100000:1.0:1788687627.421581:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687627.421632:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839583232 00000100:00100000:1.0:1788687627.421638:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839583232 00010000:00010000:1.0:1788687627.421884:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448aea expref: 14 pid: 5831 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687627.422026:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788687627.422037:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c6909050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:3312:x1875574839583232:12345-0@lo:103: 00010000:00010000:1.0:1788687627.422050:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687627.422055:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448aea expref: 14 pid: 5831 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422075:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448aea expref: 14 pid: 5831 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422090:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448aea expref: 14 pid: 5831 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422103:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422111:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788687627.422126:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007377720s 00010000:00010000:1.0:1788687627.422131:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422139:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422146:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422152:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422157:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c0031800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687627.422161:0:5825:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422181:0:5825:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422203:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422213:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687627.422253:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c6909050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3312:x1875574839583232:12345-0@lo:103: Request processed in 218us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687627.422260:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788687627.422460:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422538:0:5855:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687627.422545:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448b92 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687627.422589:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839583232:0@lo:103: 00000100:00100000:3.0:1788687627.431565:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:6684:x1875574839582976:12345-0@lo:253: Request processed in 60713us (62130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687627.431580:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788687627.434131:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:6684:1875574839582976:0@lo:253: 10000000:01000000:0.0:1788687627.434153:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788687627.434157:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788687627.434158:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788687627.434160:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687627.434161:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687627.434172:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687627.434173:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687627.434175:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788687627.434176:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788687627.434178:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788687627.434179:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687627.434180:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788687627.434195:0:6684:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788687627.442999:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687627.443350:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687627.443817:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687627.444101:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687627.444323:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687627.450888:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788687627.452304:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788687627.740001:0:6684:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788687627.740009:0:6684:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788687627.740057:0:6684:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788687627.740136:0:6684:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788687627.740154:0:6684:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788687627.740193:0:6684:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788687627.784644:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687628.807029:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687629.831201:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687630.854726:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687631.879772:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687632.456010:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839583488:0@lo:400: 00000100:00100000:2.0:1788687632.456132:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839583360:0@lo:400: 00000100:00100000:1.0:1788687632.456145:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687632.456220:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839583616:0@lo:400: 00000100:00100000:1.0:1788687632.457149:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687632.457310:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687632.457372:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839583360 00000100:00100000:2.0:1788687632.457381:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839583360 00000100:00100000:3.0:1788687632.457568:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839583488 00000100:00100000:3.0:1788687632.457574:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839583488 00000100:00100000:3.0:1788687632.457612:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839583616 00000100:00100000:3.0:1788687632.457615:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839583616 00000100:00100000:3.0:1788687632.457640:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788687632.457649:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839583488:12345-0@lo:400: 00000100:00100000:3.0:1788687632.457704:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839583488:12345-0@lo:400: Request processed in 56us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687632.457711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788687632.457743:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788687632.457749:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839583616:12345-0@lo:400: 00000100:00100000:3.0:1788687632.457780:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839583616:12345-0@lo:400: Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687632.457793:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788687632.457812:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788687632.458290:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c5b64700 x1875574839583616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687632.458306:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839583616:0@lo:400: 00010000:00080000:1.0:1788687632.458409:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c5b67100 x1875574839583488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687632.458419:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839583488:0@lo:400: 00000100:00100000:2.0:1788687632.460337:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788687632.460351:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:3310:x1875574839583360:12345-0@lo:400: 00000100:00100000:2.0:1788687632.460428:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:3310:x1875574839583360:12345-0@lo:400: Request processed in 82us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687632.460435:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788687632.460494:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839583360:0@lo:400: 00010000:00010000:1.0:1788687632.903688:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687633.931718:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788687634.185121:0:7051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1788687634.507075:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788687634.507084:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3e6e77800 from 21 10000000:01000000:2.0:1788687634.507090:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788687634.507139:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687634.507162:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687634.507172:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687634.507195:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839583744:0@lo:101: 00000100:00100000:2.0:1788687634.507261:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687634.507308:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c722f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788687634.508246:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839583744 00000100:00100000:3.0:1788687634.508256:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839583744 00000100:00100000:3.0:1788687634.508306:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788687634.508315:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5836:x1875574839583744:12345-0@lo:101: 00010000:00010000:3.0:1788687634.508331:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687634.508346:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448ba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448b99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687634.508371:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448b99 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687634.508382:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448b99 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687634.508390:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad800, rc 0) 00000100:00100000:2.0:1788687634.509874:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839583744:12345-0@lo:101: Request processed in 1553us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687634.509884:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788687634.510152:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839583744:0@lo:101: 00010000:00010000:3.0:1788687634.510177:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687634.510189:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687634.510257:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839583872:0@lo:501: 00000100:00100000:3.0:1788687634.510291:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687634.510362:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c684d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788687634.510590:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839583872 00000100:00100000:1.0:1788687634.510596:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839583872 00000100:00100000:1.0:1788687634.510638:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788687634.510648:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839583872:12345-0@lo:501: 00000100:00100000:1.0:1788687634.511148:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839583872:12345-0@lo:501: Request processed in 499us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687634.511157:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788687634.511228:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839583872:0@lo:501: 00000100:00100000:3.0:1788687634.511271:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584000:0@lo:503: 00000100:00100000:3.0:1788687634.511308:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687634.511371:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c684d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788687634.511725:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839584000 00000100:00100000:0.0:1788687634.511731:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839584000 00000100:00100000:0.0:1788687634.511771:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788687634.511786:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839584000:12345-0@lo:503: 00000100:00100000:0.0:1788687634.512104:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839584000:12345-0@lo:503: Request processed in 319us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687634.512111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788687634.512254:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584000:0@lo:503: 00000100:00100000:1.0:1788687634.512704:0:7071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7071:1875574839584128:0@lo:502: 00000100:00100000:1.0:1788687634.512745:0:7071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687634.512773:0:7071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1788687634.512827:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839584128 00000100:00100000:0.0:1788687634.512832:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839584128 00000100:00100000:0.0:1788687634.512882:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788687634.512889:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7071:x1875574839584128:12345-0@lo:502: 00000100:00100000:0.0:1788687634.513153:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7071:x1875574839584128:12345-0@lo:502: Request processed in 263us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687634.513160:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788687634.513400:0:7071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7071:1875574839584128:0@lo:502: 00000100:00100000:0.0:1788687634.520949:0:7071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7071:1875574839584256:0@lo:502: 00000100:00100000:0.0:1788687634.521050:0:7071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687634.521098:0:7071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fcdb3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788687634.523039:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839584256 00000100:00100000:0.0:1788687634.523054:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839584256 00000100:00100000:0.0:1788687634.523116:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788687634.523125:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7071:x1875574839584256:12345-0@lo:502: 00000100:00100000:0.0:1788687634.523426:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7071:x1875574839584256:12345-0@lo:502: Request processed in 301us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687634.523434:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788687634.523547:0:7071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7071:1875574839584256:0@lo:502: 00000040:00080000:0.0:1788687634.523587:0:7071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788687634.523847:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788687634.523881:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788687634.523893:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687634.523904:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687634.523914:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788687634.523916:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af3e6e77800 from 4 10000000:01000000:3.0:1788687634.523919:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788687634.523953:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687634.523960:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687634.523969:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687634.523989:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584384:0@lo:101: 00000100:00100000:3.0:1788687634.524036:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687634.524071:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c684d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788687634.524510:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839584384 00000100:00100000:0.0:1788687634.524518:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839584384 00000100:00100000:0.0:1788687634.524553:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788687634.524563:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839584384:12345-0@lo:101: 00010000:00010000:0.0:1788687634.524581:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687634.524597:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c0030200/0xc2ddd83e74448bae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448ba7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.524622:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c0030200/0xc2ddd83e74448bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448ba7 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.524634:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c0030200/0xc2ddd83e74448bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448ba7 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.524643:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c0030200, rc 0) 00000100:00100000:0.0:1788687634.524685:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839584384:12345-0@lo:101: Request processed in 124us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687634.524691:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788687634.524736:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584384:0@lo:101: 00010000:00010000:0.0:1788687634.524750:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.524759:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687634.524811:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584512:0@lo:256: 00000100:00100000:0.0:1788687634.524842:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687634.524939:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8912240 going to sleep for 11 seconds 00000100:00100000:0.0:1788687634.524955:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839584512 00000100:00100000:0.0:1788687634.524959:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839584512 00000100:00100000:0.0:1788687634.524980:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788687634.524987:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839584512:12345-0@lo:256: 20000000:01000000:0.0:1788687634.525010:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788687634.525035:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788687634.525039:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788687634.525122:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839584512:12345-0@lo:256: Request processed in 135us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687634.525129:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788687634.525159:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584512:0@lo:256: 10000000:01000000:0.0:1788687634.525194:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788687634.525200:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.525207:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687634.525215:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788687634.525217:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788687634.525220:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788687634.525237:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.525243:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.525250:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687634.525262:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584640:0@lo:101: 00000100:00100000:0.0:1788687634.525286:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687634.525299:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8912240 going to sleep for 11 seconds 00000100:00100000:0.0:1788687634.525317:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839584640 00000100:00100000:0.0:1788687634.525320:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839584640 00000100:00100000:0.0:1788687634.525341:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788687634.525348:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839584640:12345-0@lo:101: 00010000:00010000:0.0:1788687634.525355:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687634.525365:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448bbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448bb5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.525380:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448bb5 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.525388:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448bb5 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.525396:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c0030600, rc 0) 00000100:00100000:0.0:1788687634.526233:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839584640:12345-0@lo:101: Request processed in 882us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687634.526242:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788687634.526288:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584640:0@lo:101: 00010000:00010000:0.0:1788687634.526304:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687634.526314:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687634.526367:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584768:0@lo:501: 00000100:00100000:0.0:1788687634.526396:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687634.526768:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8912240 going to sleep for 11 seconds 00000100:00100000:0.0:1788687634.526782:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839584768 00000100:00100000:0.0:1788687634.526794:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839584768 00000100:00100000:0.0:1788687634.526819:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788687634.526826:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839584768:12345-0@lo:501: 00000100:00100000:0.0:1788687634.527153:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839584768:12345-0@lo:501: Request processed in 326us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687634.527160:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788687634.527624:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584768:0@lo:501: 00000100:00100000:2.0:1788687634.527662:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584896:0@lo:503: 00000100:00100000:2.0:1788687634.527708:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687634.527728:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c722f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788687634.527901:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839584896 00000100:00100000:0.0:1788687634.527907:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839584896 00000100:00100000:0.0:1788687634.527943:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788687634.527952:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839584896:12345-0@lo:503: 00000100:00100000:0.0:1788687634.528302:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839584896:12345-0@lo:503: Request processed in 350us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687634.528309:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788687634.528628:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839584896:0@lo:503: 00000100:00100000:1.0:1788687634.533070:0:7073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7073:1875574839585024:0@lo:502: 00000100:00100000:1.0:1788687634.533154:0:7073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687634.533239:0:7073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788687634.538641:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839585024 00000100:00100000:0.0:1788687634.538661:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839585024 00000100:00100000:1.0:1788687634.539627:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788687634.539640:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:7073:x1875574839585024:12345-0@lo:502: 00000100:00100000:1.0:1788687634.540017:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:7073:x1875574839585024:12345-0@lo:502: Request processed in 380us (6862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687634.540033:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788687634.540469:0:7073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7073:1875574839585024:0@lo:502: 00000020:01000000:3.0:1788687634.540520:0:7073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788687634.540537:0:7073:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788687634.540545:0:7073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687634.540547:0:7073:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788687634.540553:0:7073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788687634.540557:0:7073:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:3.0:1788687634.540581:0:7073:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788687634.540584:0:7073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788687634.540599:0:7073:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9af3c2eb99c0) 00000020:00000080:3.0:1788687634.540620:0:7073:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788687634.540625:0:7073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788687634.540703:0:7073:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788687634.540709:0:7073:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788687634.540716:0:7073:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74448bca 00010000:00080000:3.0:1788687634.540746:0:7073:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af3f343a800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1788687634.540985:0:7073:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788687634.572840:0:7073:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788687634.572863:0:7073:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788687634.573467:0:7073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788687634.573697:0:7073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788687634.573750:0:7073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788687634.573810:0:7073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788687634.574416:0:7076:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788687634.574422:0:7076:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788687634.575164:0:7073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788687634.575177:0:7073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788687634.575211:0:7073:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788687634.575232:0:7073:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2ddd83e74448bd1 00000100:00080000:1.0:1788687634.575244:0:7073:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788687634.575250:0:7073:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9af3f343a800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788687634.575285:0:7073:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3c5b66a00 x1875574839585152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788687634.575352:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839585152:0@lo:8: 00000100:00100000:0.0:1788687634.575427:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687634.575574:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839585152 00000100:00100000:3.0:1788687634.575583:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839585152 00000100:00100000:3.0:1788687634.575622:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788687634.575628:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1875574839585152:12345-0@lo:8: 00010000:00080000:3.0:1788687634.575654:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1788687634.575683:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2ddd83e74448bd8 00002000:00100000:3.0:1788687634.575713:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9af3f3438000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788687634.575718:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788687634.575723:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788687634.575830:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788687634.575961:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788687634.575988:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9af3f343e800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788687634.576183:0:7073:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788687634.576247:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839585280:0@lo:400: 00000100:00100000:1.0:1788687634.576278:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687634.576317:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839585280 00000100:00100000:1.0:1788687634.576321:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839585280 00000100:00100000:1.0:1788687634.576352:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788687634.576359:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839585280:12345-0@lo:400: 00000100:00100000:1.0:1788687634.576394:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839585280:12345-0@lo:400: Request processed in 35us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687634.576401:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788687634.576440:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c5b67480 x1875574839585280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687634.576454:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839585280:0@lo:400: 00000100:00100000:1.0:1788687634.576510:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687634.576651:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839585408:0@lo:400: 00000100:00100000:1.0:1788687634.576678:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788687634.576830:0:7073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788687634.576836:0:7073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687634.576839:0:7073:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788687634.576841:0:7073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788687634.576845:0:7073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687634.576847:0:7073:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788687634.576850:0:7073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788687634.576852:0:7073:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788687634.576875:0:7073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7073:1875574839585536:0@lo:502: 00000100:00100000:1.0:1788687634.576917:0:7073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687634.576942:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839585536 00000100:00100000:1.0:1788687634.576946:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839585536 00000100:00100000:1.0:1788687634.576971:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788687634.576977:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:7073:x1875574839585536:12345-0@lo:502: 00000100:00100000:1.0:1788687634.577188:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:7073:x1875574839585536:12345-0@lo:502: Request processed in 210us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687634.577195:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788687634.577238:0:7073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8cef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687634.577252:0:7073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7073:1875574839585536:0@lo:502: 00000020:01000000:1.0:1788687634.577275:0:7073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788687634.577279:0:7073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687634.577281:0:7073:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788687634.577284:0:7073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788687634.577329:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788687634.577353:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788687634.577363:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687634.577384:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687634.577395:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788687634.577399:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af3e0230000 from 1 10000000:01000000:1.0:1788687634.577402:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788687634.577426:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687634.577433:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687634.577441:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687634.577453:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839585664:0@lo:101: 00000100:00100000:1.0:1788687634.577499:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687634.577518:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6eacd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788687634.577605:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839585664 00000100:00100000:1.0:1788687634.577610:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839585664 00000100:00100000:1.0:1788687634.577631:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788687634.577637:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839585664:12345-0@lo:101: 00010000:00010000:1.0:1788687634.577645:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687634.577659:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448be6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448bdf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687634.577679:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448bdf expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687634.577701:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448bdf expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687634.577710:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ede00, rc 0) 00000100:00100000:1.0:1788687634.577739:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839585664:12345-0@lo:101: Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687634.577745:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788687634.577774:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839585664:0@lo:101: 00010000:00010000:1.0:1788687634.577785:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687634.577793:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687634.577832:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839585792:0@lo:501: 00000100:00100000:1.0:1788687634.577853:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687634.577866:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6eacd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788687634.577879:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839585792 00000100:00100000:1.0:1788687634.577882:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839585792 00000100:00100000:1.0:1788687634.577902:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788687634.577908:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839585792:12345-0@lo:501: 00000100:00100000:1.0:1788687634.578134:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839585792:12345-0@lo:501: Request processed in 225us (279us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788687634.578140:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788687634.578172:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839585792:0@lo:501: 10000000:01000000:1.0:1788687634.578190:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788687634.578200:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687634.578207:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687634.578618:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875574839585152:12345-0@lo:8: Request processed in 2987us (3188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687634.578627:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788687634.578740:0:3309:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c5b66a00 x1875574839585152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788687644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687634.578752:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788687634.578761:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788687634.578769:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788687634.578775:0:3309:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788687634.578778:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f343a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788687634.578802:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788687634.578808:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839585152:0@lo:8: 00000100:00100000:2.0:1788687634.580330:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839585408 00000100:00100000:2.0:1788687634.580341:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839585408 00000100:00100000:2.0:1788687634.580391:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788687634.580401:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839585408:12345-0@lo:400: 00000100:00100000:2.0:1788687634.580493:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839585408:12345-0@lo:400: Request processed in 81us (3800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687634.580514:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788687634.580545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788687634.580557:0:7076:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788687634.580709:0:7076:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 180271227875ns, next at 0ns, rc = 0 00010000:00080000:1.0:1788687634.580946:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c5b67480 x1875574839585408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687634.580960:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839585408:0@lo:400: 00000004:00080000:3.0:1788687634.610533:0:7077:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788687634.610565:0:7077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7077:1875574839586048:0@lo:7: 00000100:00100000:3.0:1788687634.610635:0:7077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687634.610690:0:7077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c684d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788687634.610714:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839586048 00000100:00100000:3.0:1788687634.610722:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839586048 00000100:00100000:3.0:1788687634.610778:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687634.610787:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7077:x1875574839586048:12345-0@lo:7: 00000100:00100000:2.0:1788687634.613430:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687634.613458:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839585920:0@lo:13: 00000100:00100000:2.0:1788687634.613564:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687634.613756:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839585920 00000100:00100000:1.0:1788687634.613769:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839585920 00000100:00100000:1.0:1788687634.613841:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788687634.613853:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839585920:12345-0@lo:13: 00002000:00000024:1.0:1788687634.613894:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788687634.613960:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839585920:12345-0@lo:13: Request processed in 108us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687634.613968:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788687634.614059:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3f3417800 x1875574839585920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687634.614081:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839585920:0@lo:13: 00000100:00080000:3.0:1788687634.615816:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788687634.617757:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788687634.617765:0:6689:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788687634.617861:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7077:x1875574839586048:12345-0@lo:7: Request processed in 7071us (7222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687634.617871:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788687634.617927:0:7077:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3f3415880 x1875574839586048/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788687650 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687634.617943:0:7077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7077:1875574839586048:0@lo:7: 00000004:00080000:3.0:1788687634.617957:0:7077:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788687634.617993:0:7077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7077:1875574839586176:0@lo:5: 00000100:00100000:3.0:1788687634.618034:0:7077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687634.618067:0:7077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c684d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788687634.618085:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839586176 00000100:00100000:3.0:1788687634.618091:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839586176 00000100:00100000:3.0:1788687634.618127:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788687634.618143:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7077:x1875574839586176:12345-0@lo:5: 00002000:00080000:3.0:1788687634.618167:0:6686:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788687634.618170:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788687634.618356:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7077:x1875574839586176:12345-0@lo:5: Request processed in 214us (332us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788687634.618364:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788687634.618393:0:7077:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3f3415880 x1875574839586176/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788687650 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687634.618404:0:7077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7077:1875574839586176:0@lo:5: 00000004:00080000:3.0:1788687634.618413:0:7077:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788687634.618434:0:7077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3416d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7077:1875574839586304:0@lo:700: 00000100:00100000:3.0:1788687634.618457:0:7077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687634.618476:0:7077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c684d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788687634.618713:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839586304 00000100:00100000:0.0:1788687634.618723:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839586304 00000100:00100000:0.0:1788687634.618800:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788687634.618808:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7077:x1875574839586304:12345-0@lo:700: 00000100:00100000:0.0:1788687634.618834:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e89500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1875574839586432:0@lo:700: 00000100:00100000:0.0:1788687634.618861:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687634.618883:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8325e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687634.619168:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839586432 00000100:00100000:3.0:1788687634.619173:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839586432 00000100:00100000:3.0:1788687634.621279:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788687634.621306:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1875574839586432:12345-0@lo:700: 00000004:00080000:1.0:1788687634.647814:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788687634.671826:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788687634.679885:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1875574839586432:12345-0@lo:700: Request processed in 58581us (61013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687634.679906:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788687634.685831:0:6695:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c2e89500 x1875574839586432/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788687650 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687634.685851:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e89500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1875574839586432:0@lo:700: 40000000:02000000:0.0:1788687634.685865:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788687634.772241:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788687634.772262:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1788687634.772692:0:7077:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3f3416d80 x1875574839586304/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788687650 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687634.772706:0:7077:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788687634.774235:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7077:x1875574839586304:12345-0@lo:700: Request processed in 155416us (155764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687634.774287:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788687634.774403:0:7077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3416d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7077:1875574839586304:0@lo:700: 00000004:02000040:3.0:1788687634.901266:0:7077:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788687634.908465:0:7077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3416d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7077:1875574839586560:0@lo:5: 00000100:00100000:0.0:1788687634.910232:0:7077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687634.910296:0:7077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1788687634.910813:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839586560 00000100:00100000:3.0:1788687634.910830:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839586560 00000100:00100000:3.0:1788687634.910899:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788687634.910911:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7077:x1875574839586560:12345-0@lo:5: 00002000:00080000:0.0:1788687634.927411:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788687634.927434:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788687634.935141:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7077:x1875574839586560:12345-0@lo:5: Request processed in 24224us (24903us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788687634.935160:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788687634.935257:0:7077:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3f3416d80 x1875574839586560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788687650 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687634.935278:0:7077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3416d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7077:1875574839586560:0@lo:5: 00000004:00080000:0.0:1788687634.935297:0:7077:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788687634.950763:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687635.974659:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687636.997992:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687638.021775:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788687639.017265:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788687639.046718:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687639.622910:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839586688:0@lo:400: 00000100:00100000:2.0:1788687639.623007:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687639.623081:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788687639.623088:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839586816:0@lo:400: 00000100:00100000:2.0:1788687639.623114:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687639.623141:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839586944:0@lo:400: 00000100:00100000:2.0:1788687639.623164:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687639.623177:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687639.623182:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839587072:0@lo:400: 00000100:00100000:2.0:1788687639.623199:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687639.623225:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839586688 00000100:00100000:2.0:1788687639.623232:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839586688 00000100:00100000:2.0:1788687639.623290:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788687639.623298:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:3312:x1875574839586688:12345-0@lo:400: 00000100:00100000:2.0:1788687639.623340:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:3312:x1875574839586688:12345-0@lo:400: Request processed in 43us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687639.623346:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788687639.623392:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839586816 00000100:00100000:2.0:1788687639.623395:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839586816 00000100:00100000:2.0:1788687639.623414:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839586944 00000100:00100000:2.0:1788687639.623416:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839586944 00000100:00100000:2.0:1788687639.623446:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788687639.623452:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839586816:12345-0@lo:400: 00000100:00100000:2.0:1788687639.623579:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839586816:12345-0@lo:400: Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687639.623586:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788687639.623598:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788687639.623605:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839586944:12345-0@lo:400: 00000100:00100000:2.0:1788687639.623636:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839586944:12345-0@lo:400: Request processed in 32us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687639.623641:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788687639.623665:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839587072 00000100:00100000:2.0:1788687639.623668:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839587072 00000100:00100000:2.0:1788687639.623691:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788687639.623696:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839587072:12345-0@lo:400: 00000100:00100000:2.0:1788687639.623723:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839587072:12345-0@lo:400: Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687639.623728:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788687639.624034:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3f40bad80 x1875574839586816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687639.624059:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839586816:0@lo:400: 00000100:00100000:2.0:1788687639.624072:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839586688:0@lo:400: 00000100:00080000:2.0:1788687639.624103:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788687639.624107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788687639.624135:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3f40bb100 x1875574839587072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687639.624143:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788687639.624152:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839587072:0@lo:400: 00010000:00080000:2.0:1788687639.624160:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3f40ba680 x1875574839586944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687639.624168:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839586944:0@lo:400: 00000100:00100000:2.0:1788687639.629922:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839587200:0@lo:13: 00000100:00100000:2.0:1788687639.630010:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687639.630242:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839587200 00000100:00100000:1.0:1788687639.630252:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839587200 00000100:00100000:1.0:1788687639.630310:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788687639.630320:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839587200:12345-0@lo:13: 00002000:00000024:1.0:1788687639.631030:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687639.631106:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839587200:12345-0@lo:13: Request processed in 786us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687639.631114:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788687639.631285:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3f3415880 x1875574839587200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687639.631307:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839587200:0@lo:13: 00010000:00010000:1.0:1788687640.069637:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687641.096431:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687642.123223:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687643.143631:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687644.165693:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687644.743747:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839587328:0@lo:400: 00000100:00100000:2.0:1788687644.743942:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687644.744008:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788687644.744015:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839587712:0@lo:400: 00000100:00100000:2.0:1788687644.744041:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687644.744074:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839587456:0@lo:400: 00000100:00100000:2.0:1788687644.744112:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687644.744130:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687644.744135:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839587584:0@lo:400: 00000100:00100000:2.0:1788687644.744152:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687644.744178:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839587712 00000100:00100000:2.0:1788687644.744184:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839587712 00000100:00100000:2.0:1788687644.744233:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788687644.744242:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839587712:12345-0@lo:400: 00000100:00100000:2.0:1788687644.744288:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839587712:12345-0@lo:400: Request processed in 46us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687644.744295:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788687644.744315:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839587456 00000100:00100000:2.0:1788687644.744318:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839587456 00000100:00100000:0.0:1788687644.744414:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839587328 00000100:00100000:0.0:1788687644.744418:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839587328 00000100:00100000:0.0:1788687644.744447:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788687644.744454:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:3313:x1875574839587328:12345-0@lo:400: 00000100:00100000:0.0:1788687644.744506:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:3313:x1875574839587328:12345-0@lo:400: Request processed in 53us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687644.744513:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788687644.744631:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839587584 00000100:00100000:2.0:1788687644.744635:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839587584 00000100:00100000:0.0:1788687644.749140:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788687644.749190:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839587456:12345-0@lo:400: 00000100:00100000:0.0:1788687644.749303:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839587456:12345-0@lo:400: Request processed in 133us (5190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687644.749312:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788687644.749350:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788687644.749358:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839587584:12345-0@lo:400: 00000100:00100000:0.0:1788687644.749386:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839587584:12345-0@lo:400: Request processed in 30us (5233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687644.749392:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788687644.749634:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c2e88a80 x1875574839587584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687644.749648:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839587584:0@lo:400: 00010000:00080000:3.0:1788687644.749660:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c2e8ad80 x1875574839587456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687644.749667:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839587456:0@lo:400: 00000100:00080000:2.0:1788687644.750270:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788687644.750276:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788687644.752260:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788687644.752289:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839587840:0@lo:13: 00000100:00100000:0.0:1788687644.752381:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788687644.755262:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c2e8a300 x1875574839587712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687644.755281:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839587712:0@lo:400: 00000100:00100000:2.0:1788687644.755294:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839587328:0@lo:400: 00000100:00100000:2.0:1788687644.755360:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839587840 00000100:00100000:2.0:1788687644.755368:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839587840 00000100:00100000:2.0:1788687644.755425:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788687644.755437:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839587840:12345-0@lo:13: 00002000:00000024:2.0:1788687644.755477:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687644.755579:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839587840:12345-0@lo:13: Request processed in 144us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687644.755597:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788687644.755631:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3f3417100 x1875574839587840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687644.755646:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839587840:0@lo:13: 00000020:01000004:3.0:1788687644.858769:0:7627:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788687644.858773:0:7627:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788687644.858914:0:7627:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9af3ffb81000 00000020:01000004:3.0:1788687644.858930:0:7627:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788687644.858943:0:7627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788687644.858956:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9af3c2eb8000) 00000020:00000080:3.0:1788687644.858971:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788687644.883923:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788687644.884540:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788687644.934667:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788687644.943914:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788687644.943955:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788687644.944026:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788687644.944055:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788687644.945084:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788687644.945097:0:7627:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788687644.945116:0:7627:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc2ddd83e74448bf4 00000020:01000004:3.0:1788687644.945124:0:7627:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788687644.945148:0:7627:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788687644.945152:0:7627:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788687644.945158:0:7627:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788687644.945180:0:7627:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788687644.945184:0:7627:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788687644.969989:0:7627:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788687644.970033:0:7627:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.126@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788687644.970037:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788687644.970039:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788687644.970040:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788687644.970041:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788687644.970042:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788687644.970043:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788687644.970045:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788687644.970046:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788687644.970048:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788687644.970049:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788687644.970051:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788687644.970054:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788687644.970057:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788687644.970058:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788687644.970059:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788687644.970060:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788687644.970061:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788687644.970063:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788687644.970069:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788687644.970070:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788687644.970071:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788687644.970072:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788687644.970073:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788687644.970099:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788687644.970117:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839587968:0@lo:253: 00000100:00100000:1.0:1788687644.970189:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687644.970467:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839587968 00000100:00100000:2.0:1788687644.970512:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839587968 00000100:00100000:2.0:1788687644.970571:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788687644.970611:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:7627:x1875574839587968:12345-0@lo:253: 20000000:01000000:0.0:1788687644.970647:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788687644.970651:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788687644.970656:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788687644.970659:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000100:00100000:1.0:1788687644.971857:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1900 going to sleep for 11 seconds 00000040:00080000:0.0:1788687644.975312:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788687644.975558:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788687644.975574:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788687644.975614:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788687644.975624:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788687644.975655:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788687644.975735:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788687644.977359:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788687644.977386:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:0.0:1788687644.977388:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788687644.977440:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788687644.977448:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788687644.977593:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788687644.977602:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1788687644.977634:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788687644.977643:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788687644.977675:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788687644.978112:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788687644.981978:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788687644.982015:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:0.0:1788687644.982018:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788687644.982055:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788687644.982063:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788687644.982093:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788687644.982101:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1788687644.982131:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788687644.982141:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788687644.982190:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788687644.982407:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788687644.982587:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788687644.982591:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788687644.982595:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788687644.982609:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788687644.982612:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788687644.982846:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788687644.982849:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788687644.984209:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788687644.985566:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788687644.985716:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788687644.986534:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788687644.986587:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788687644.986662:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788687644.986676:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788687644.986679:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788687644.987360:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788687644.988163:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788687644.988206:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788687644.988276:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788687644.988291:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788687644.988293:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788687644.990296:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788687644.990393:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788687644.990429:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788687644.991425:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788687644.991476:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788687644.991584:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788687644.991600:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788687644.991615:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788687644.994818:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788687644.994922:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788687644.994976:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788687644.995979:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788687644.996025:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788687644.996061:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788687644.996081:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788687644.996083:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788687644.996093:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788687644.996117:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996139:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4021d8000/0xc2ddd83e74448b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448b45 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996161:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448b6f expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996168:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448b99 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996175:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448bbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448bb5 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996182:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448bdf expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996190:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996288:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448bdf expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996302:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448bdf expref: 16 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687644.996428:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875574839588096:0@lo:104: 00000100:00100000:1.0:1788687644.996531:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788687644.996585:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448bb5 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996593:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448bbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448bb5 expref: 16 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687644.996601:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875574839588224:0@lo:104: 00010000:00010000:1.0:1788687644.996835:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448b99 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996844:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448b99 expref: 16 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687644.996853:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b64700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875574839588352:0@lo:104: 00010000:00010000:1.0:1788687644.996885:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448b6f expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996894:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448b6f expref: 16 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687644.996902:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875574839588480:0@lo:104: 00010000:00010000:1.0:1788687644.996924:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4021d8000/0xc2ddd83e74448b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448b45 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687644.996932:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4021d8000/0xc2ddd83e74448b4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448b45 expref: 16 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687644.996939:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875574839588608:0@lo:104: 00000100:00100000:1.0:1788687644.996974:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788687644.997126:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788687644.997148:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687644.997165:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687644.997173:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687644.997187:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687644.997262:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839588096 00000100:00100000:3.0:1788687644.997270:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839588096 00000100:00100000:3.0:1788687644.997302:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839588224 00000100:00100000:3.0:1788687644.997305:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839588224 00000100:00100000:3.0:1788687644.997314:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839588352 00000100:00100000:3.0:1788687644.997326:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839588352 00000100:00100000:3.0:1788687644.997338:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839588480 00000100:00100000:3.0:1788687644.997340:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839588480 00000100:00100000:3.0:1788687644.997347:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839588608 00000100:00100000:3.0:1788687644.997349:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839588608 00000100:00100000:3.0:1788687644.997360:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788687644.997369:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+7:5834:x1875574839588096:12345-0@lo:104: 00010000:00010000:3.0:1788687644.997383:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687644.997455:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788687644.997462:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+7:5834:x1875574839588096:12345-0@lo:104: Request processed in 94us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687644.997468:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788687644.997528:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788687644.997534:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+6:5834:x1875574839588224:12345-0@lo:104: 00010000:00010000:3.0:1788687644.997541:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687644.997587:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788687644.997592:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+6:5834:x1875574839588224:12345-0@lo:104: Request processed in 59us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687644.997597:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788687644.997610:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788687644.997616:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:5834:x1875574839588352:12345-0@lo:104: 00010000:00010000:3.0:1788687644.997623:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999175:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788687644.999189:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999200:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ec400 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687644.999205:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999214:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687644.999222:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687644.999228:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687644.999282:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999288:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788687644.999289:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875574839588096:0@lo:104: 00000100:00100000:1.0:1788687644.999301:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875574839588224:0@lo:104: 00010000:00010000:2.0:1788687644.999321:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999344:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec400/0xc2ddd83e74448bdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448be6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999358:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687644.999362:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999368:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c0031800 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687644.999371:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999378:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687644.999385:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687644.999390:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687644.999404:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999410:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687644.999415:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999422:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c0031800/0xc2ddd83e74448bb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448bbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687644.999432:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687644.999440:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687644.999442:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687644.999496:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839588864:0@lo:103: 00000100:00100000:2.0:1788687644.999553:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687644.999586:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788687644.999591:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839588736:0@lo:103: 00000100:00100000:2.0:1788687644.999610:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788687644.999799:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788687644.999806:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:5834:x1875574839588352:12345-0@lo:104: Request processed in 2190us (2639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687644.999815:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788687644.999851:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788687644.999861:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:5834:x1875574839588480:12345-0@lo:104: 00010000:00010000:3.0:1788687644.999870:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687644.999898:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788687644.999902:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:5834:x1875574839588480:12345-0@lo:104: Request processed in 45us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687644.999908:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788687644.999921:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788687644.999927:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:5834:x1875574839588608:12345-0@lo:104: 00010000:00010000:3.0:1788687644.999934:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687644.999968:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788687644.999973:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:5834:x1875574839588608:12345-0@lo:104: Request processed in 47us (2786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687644.999980:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788687644.999996:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788687645.000000:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000007:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9800 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:3.0:1788687645.000010:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000016:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788687645.000023:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687645.000028:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788687645.000049:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000054:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788687645.000068:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000074:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af4021d9800/0xc2ddd83e74448b99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ba0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000094:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788687645.000097:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000102:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c0030000 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:3.0:1788687645.000105:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687645.000106:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b64700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875574839588352:0@lo:104: 00010000:00010000:3.0:1788687645.000112:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687645.000114:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875574839588480:0@lo:104: 10000000:00010000:3.0:1788687645.000120:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687645.000121:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875574839588608:0@lo:104: 10000000:01000000:3.0:1788687645.000125:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788687645.000136:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000141:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788687645.000146:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000152:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448b6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b76 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.000152:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000161:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687645.000164:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000179:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:3.0:1788687645.000182:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.000188:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687645.000282:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839588864 00000100:00100000:1.0:1788687645.000288:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839588864 00010000:00010000:1.0:1788687645.000310:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448bbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448bb5 expref: 17 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687645.000423:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839588736 00000100:00100000:1.0:1788687645.000427:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839588736 00010000:00010000:1.0:1788687645.000441:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448bdf expref: 18 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687645.000444:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788687645.000452:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788687645.000459:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788687645.000465:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:3311:x1875574839588864:12345-0@lo:103: 00010000:00010000:2.0:1788687645.000476:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687645.000498:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448bbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448bb5 expref: 18 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.000508:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448bb5 expref: 18 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.000523:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448bbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448bb5 expref: 18 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.000535:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687645.000565:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:3311:x1875574839588864:12345-0@lo:103: Request processed in 114us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687645.000578:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788687645.000582:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788687645.000588:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:3311:x1875574839588736:12345-0@lo:103: 00000100:00100000:2.0:1788687645.000607:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839588864:0@lo:103: 00010000:00010000:1.0:1788687645.000608:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687645.000613:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448bdf expref: 16 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.000621:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448bdf expref: 16 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.000981:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448be6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448bdf expref: 16 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.000993:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:3.0:1788687645.001103:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687645.001111:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788687645.001130:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.001136:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788687645.001219:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:3311:x1875574839588736:12345-0@lo:103: Request processed in 631us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687645.001226:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788687645.001433:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.001441:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74448b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b4c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.001456:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687645.001458:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687645.001460:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687645.001474:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839589248:0@lo:103: 00000100:00100000:3.0:1788687645.001821:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.001884:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839589248 00000100:00100000:3.0:1788687645.001890:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839589248 00010000:00010000:3.0:1788687645.001908:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4021d8000/0xc2ddd83e74448b4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448b45 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687645.001944:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788687645.001951:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:3310:x1875574839589248:12345-0@lo:103: 00010000:00010000:3.0:1788687645.001962:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687645.001966:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4021d8000/0xc2ddd83e74448b4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448b45 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.001975:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4021d8000/0xc2ddd83e74448b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448b45 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.001988:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d8000/0xc2ddd83e74448b4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448b45 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.001997:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687645.002026:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:3310:x1875574839589248:12345-0@lo:103: Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687645.002031:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788687645.002055:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839588992:0@lo:103: 00000100:00100000:3.0:1788687645.002078:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.002094:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788687645.002099:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839589120:0@lo:103: 00000100:00100000:3.0:1788687645.002116:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.002150:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839589248:0@lo:103: 00000100:00100000:3.0:1788687645.002166:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839588992 00000100:00100000:3.0:1788687645.002168:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839588992 00010000:00010000:3.0:1788687645.002180:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448b99 expref: 14 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687645.002221:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839589120 00000100:00100000:3.0:1788687645.002224:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839589120 00010000:00010000:3.0:1788687645.002235:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448b6f expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687645.002244:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788687645.002249:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:3312:x1875574839588992:12345-0@lo:103: 00010000:00010000:3.0:1788687645.002256:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687645.002260:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448b99 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002268:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448b99 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002278:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448ba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448b99 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002286:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687645.002311:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:3312:x1875574839588992:12345-0@lo:103: Request processed in 62us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687645.002331:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788687645.002342:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788687645.002348:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3312:x1875574839589120:12345-0@lo:103: 00010000:00010000:3.0:1788687645.002356:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687645.002360:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448b6f expref: 13 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002369:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448b6f expref: 13 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002384:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448b76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448b6f expref: 13 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002395:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002405:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002419:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002426:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002432:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002438:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002444:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ec800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687645.002448:0:5824:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002456:0:5824:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002471:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002514:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687645.002538:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:3312:x1875574839589120:12345-0@lo:103: Request processed in 190us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687645.002545:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788687645.002567:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839589120:0@lo:103: 00000100:00100000:3.0:1788687645.002574:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839588992:0@lo:103: 00010000:00010000:3.0:1788687645.002595:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687645.002603:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002610:0:5834:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.002616:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448bfb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788687645.002641:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788687645.004020:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839588736:0@lo:103: 00000100:00100000:1.0:1788687645.055585:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:7627:x1875574839587968:12345-0@lo:253: Request processed in 84984us (85374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687645.055602:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788687645.055901:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839587968:0@lo:253: 10000000:01000000:2.0:1788687645.055920:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788687645.055924:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788687645.055926:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788687645.055928:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788687645.055929:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788687645.055930:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788687645.055931:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788687645.055933:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788687645.055934:0:7627:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788687645.055936:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788687645.055937:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788687645.055966:0:7627:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9af3ffb81000 from lustre-OST0001 10000000:01000000:2.0:1788687645.056005:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788687645.056008:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788687645.056016:0:7627:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9af3e0230000 local copy 10000000:01000000:2.0:1788687645.056021:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788687645.056060:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.056071:0:7627:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.056079:0:7627:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687645.056096:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839589376:0@lo:101: 00000100:00100000:2.0:1788687645.056160:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687645.056218:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c684dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687645.056343:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839589376 00000100:00100000:1.0:1788687645.056351:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839589376 00000100:00100000:1.0:1788687645.056406:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788687645.056422:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+11:7627:x1875574839589376:12345-0@lo:101: 00010000:00010000:1.0:1788687645.056448:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687645.056462:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448c09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448c02 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.056510:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448c02 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.056520:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c02 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.056535:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ede00, rc 0) 00000100:00100000:1.0:1788687645.056589:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:7627:x1875574839589376:12345-0@lo:101: Request processed in 167us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687645.056596:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788687645.057171:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839589376:0@lo:101: 00010000:00010000:2.0:1788687645.057189:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.057201:0:7627:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687645.057334:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839589504:0@lo:501: 00000100:00100000:2.0:1788687645.057369:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687645.057402:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c684dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687645.057675:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839589504 00000100:00100000:1.0:1788687645.057680:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839589504 00000100:00100000:1.0:1788687645.057721:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788687645.057729:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:7627:x1875574839589504:12345-0@lo:501: 00000100:00100000:1.0:1788687645.058001:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:7627:x1875574839589504:12345-0@lo:501: Request processed in 272us (631us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788687645.058008:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788687645.058253:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839589504:0@lo:501: 10000000:01000000:3.0:1788687645.058271:0:7627:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788687645.058299:0:7627:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788687645.058304:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.058314:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.058321:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.058362:0:7627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788687645.058385:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9af3ffb81000 10000000:01000000:3.0:1788687645.058390:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788687645.058396:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788687645.058399:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788687645.058404:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788687645.058407:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788687645.058563:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687645.058581:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.058632:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.058641:0:7627:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.058650:0:7627:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687645.058666:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839589632:0@lo:101: 00000100:00100000:3.0:1788687645.058700:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.058724:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687645.058880:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839589632 00000100:00100000:1.0:1788687645.058886:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839589632 00000100:00100000:1.0:1788687645.058925:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788687645.058933:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:7627:x1875574839589632:12345-0@lo:101: 00010000:00010000:1.0:1788687645.058941:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687645.058955:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ec600/0xc2ddd83e74448c17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448c10 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.058984:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ec600/0xc2ddd83e74448c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448c10 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.058995:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ec600/0xc2ddd83e74448c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c10 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.059003:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ec600, rc 0) 00000100:00100000:1.0:1788687645.059034:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839589632:12345-0@lo:101: Request processed in 102us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687645.059041:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788687645.059062:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839589632:0@lo:101: 00010000:00010000:2.0:1788687645.059680:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8c00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687645.059686:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.059696:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687645.059703:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687645.059710:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687645.059735:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.059754:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788687645.059834:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788687645.059900:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.059908:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af4021d8c00/0xc2ddd83e74448c02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2ddd83e74448c09 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.059922:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687645.059924:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687645.059927:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687645.059977:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.060054:0:7627:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687645.060225:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839589888:0@lo:501: 00000100:00100000:3.0:1788687645.060274:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.060308:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788687645.060367:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839589888 00000100:00100000:2.0:1788687645.060373:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839589888 00000100:00100000:2.0:1788687645.060411:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788687645.060420:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839589888:12345-0@lo:501: 00000100:00100000:2.0:1788687645.060897:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839589888:12345-0@lo:501: Request processed in 476us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687645.060905:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788687645.060993:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839589888:0@lo:501: 00000100:00100000:0.0:1788687645.061026:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590016:0@lo:503: 00000100:00100000:0.0:1788687645.061065:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687645.061096:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788687645.061332:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839590016 00000100:00100000:2.0:1788687645.061337:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839590016 00000100:00100000:2.0:1788687645.061369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788687645.061376:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590016:12345-0@lo:503: 00000100:00100000:0.0:1788687645.061729:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590016:0@lo:503: 00000040:00080000:0.0:1788687645.062037:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788687645.062113:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590144:0@lo:502: 00000100:00100000:0.0:1788687645.062279:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687645.062308:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788687645.062325:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839590144 00000100:00100000:0.0:1788687645.062330:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839590144 00000100:00100000:0.0:1788687645.062354:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788687645.062361:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839590144:12345-0@lo:502: 00000100:00100000:0.0:1788687645.062717:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839590144:12345-0@lo:502: Request processed in 356us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687645.062724:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788687645.062853:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590144:0@lo:502: 00000100:00100000:2.0:1788687645.063079:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590016:12345-0@lo:503: Request processed in 190us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687645.063088:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000040:00080000:0.0:1788687645.063812:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788687645.064124:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788687645.064227:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788687645.064270:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788687645.064299:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788687645.064392:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788687645.064434:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590272:0@lo:502: 00000100:00100000:1.0:1788687645.066116:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839589760:0@lo:103: 00000100:00100000:1.0:1788687645.066193:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.066349:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839589760 00000100:00100000:3.0:1788687645.066358:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839589760 00000100:00100000:3.0:1788687645.066424:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788687645.066518:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687645.066539:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687645.066554:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3310:x1875574839589760:12345-0@lo:103: 00000100:00100000:0.0:1788687645.066558:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839590272 00000100:00100000:0.0:1788687645.066561:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839590272 00000100:00100000:0.0:1788687645.066592:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788687645.066598:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839590272:12345-0@lo:502: 00010000:00010000:3.0:1788687645.066645:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687645.066666:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448c02 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.066685:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687645.066723:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3310:x1875574839589760:12345-0@lo:103: Request processed in 173us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687645.066845:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590272:12345-0@lo:502: Request processed in 247us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687645.066853:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788687645.066869:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590272:0@lo:502: 00000040:00080000:2.0:1788687645.067024:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788687645.067040:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:3.0:1788687645.067284:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687645.067326:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839589760:0@lo:103: 00000020:01000000:2.0:1788687645.067943:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788687645.067952:0:7634:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788687645.067958:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687645.067961:0:7634:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788687645.067967:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788687645.067983:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9af3f40d19c0) 00000020:00000080:2.0:1788687645.068016:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788687645.068023:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788687645.068095:0:7634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af3ffb81000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788687645.068103:0:7634:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788687645.068109:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc2ddd83e74448c25 00010000:00010000:3.0:1788687645.073099:0:7634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788687645.073639:0:7634:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788687645.077640:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788687645.078582:0:7634:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788687645.084312:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788687645.085746:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788687645.087876:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788687645.087888:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788687645.087895:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687645.087898:0:7634:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788687645.087902:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788687645.087906:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687645.087908:0:7634:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788687645.087911:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788687645.087913:0:7634:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788687645.087967:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788687645.087970:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687645.087971:0:7634:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788687645.087974:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788687645.088140:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788687645.088167:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788687645.088194:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.088207:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687645.088215:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3ffb81000 from 1 10000000:01000000:0.0:1788687645.088217:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788687645.088255:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.088263:0:7627:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.088284:0:7627:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687645.088309:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590400:0@lo:101: 00000100:00100000:0.0:1788687645.089109:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687645.089160:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788687645.089230:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839590400 00000100:00100000:1.0:1788687645.089237:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839590400 00000100:00100000:1.0:1788687645.089285:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788687645.089295:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:7627:x1875574839590400:12345-0@lo:101: 00010000:00010000:1.0:1788687645.089317:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687645.089645:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ed000/0xc2ddd83e74448c33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.089673:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ed000/0xc2ddd83e74448c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448c2c expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.089685:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ed000/0xc2ddd83e74448c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c2c expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.089694:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ed000, rc 0) 00000100:00100000:1.0:1788687645.089809:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590400:12345-0@lo:101: Request processed in 513us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687645.089818:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788687645.090276:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590400:0@lo:101: 00010000:00010000:0.0:1788687645.090293:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.090304:0:7627:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687645.090663:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590528:0@lo:501: 00000100:00100000:0.0:1788687645.090702:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687645.090773:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1788687645.091038:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839590528 00000100:00100000:2.0:1788687645.091044:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839590528 00000100:00100000:2.0:1788687645.091222:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788687645.091232:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590528:12345-0@lo:501: 00000100:00100000:2.0:1788687645.091689:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590528:12345-0@lo:501: Request processed in 458us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687645.091699:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788687645.091881:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590528:0@lo:501: 00000100:00100000:1.0:1788687645.091920:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590656:0@lo:503: 00000100:00100000:1.0:1788687645.091963:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687645.091994:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788687645.092035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839590656 00000100:00100000:3.0:1788687645.092040:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839590656 00000100:00100000:3.0:1788687645.092079:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788687645.092087:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590656:12345-0@lo:503: 00000100:00100000:3.0:1788687645.092404:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590656:12345-0@lo:503: Request processed in 317us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687645.092411:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788687645.092665:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590656:0@lo:503: 00000040:00080000:3.0:1788687645.094367:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788687645.094776:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590784:0@lo:502: 00000100:00100000:3.0:1788687645.095031:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.095077:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788687645.095078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839590784 00000100:00100000:0.0:1788687645.095085:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839590784 00000100:00100000:0.0:1788687645.095134:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788687645.095144:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590784:12345-0@lo:502: 00000100:00100000:0.0:1788687645.095392:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590784:12345-0@lo:502: Request processed in 249us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687645.095399:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788687645.095573:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590784:0@lo:502: 00000040:00080000:3.0:1788687645.095854:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788687645.095904:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788687645.095929:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590912:0@lo:502: 00000100:00100000:3.0:1788687645.095967:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.095995:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788687645.096013:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839590912 00000100:00100000:3.0:1788687645.096017:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839590912 00000100:00100000:3.0:1788687645.096047:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788687645.096053:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590912:12345-0@lo:502: 00000100:00100000:3.0:1788687645.096202:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839590912:12345-0@lo:502: Request processed in 148us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687645.096209:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788687645.096250:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839590912:0@lo:502: 00000040:00080000:3.0:1788687645.096322:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788687645.096330:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788687645.097000:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687645.097012:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687645.097014:0:7638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788687645.097021:0:7638:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af3ffb81000 00000020:00000080:3.0:1788687645.097023:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788687645.097042:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687645.097046:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687645.097053:0:7638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788687645.097057:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788687645.097185:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788687645.097204:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788687645.097225:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.097243:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687645.097290:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788687645.097292:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9af3ffb81000 10000000:01000000:0.0:1788687645.097295:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9af3ffb81000 10000000:01000000:0.0:1788687645.097298:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788687645.097303:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3ffb81000 from 1 10000000:01000000:0.0:1788687645.097306:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788687645.097346:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.097354:0:7627:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.097371:0:7627:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687645.097388:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591040:0@lo:101: 00000100:00100000:0.0:1788687645.097440:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687645.097471:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788687645.097668:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839591040 00000100:00100000:3.0:1788687645.097674:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839591040 00000100:00100000:3.0:1788687645.097717:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788687645.097726:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839591040:12345-0@lo:101: 00010000:00010000:3.0:1788687645.097737:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687645.097749:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74448c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448c3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.097770:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74448c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448c3a expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.097780:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74448c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c3a expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.097789:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aade00, rc 0) 00000100:00100000:3.0:1788687645.097834:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839591040:12345-0@lo:101: Request processed in 99us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687645.097841:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788687645.097890:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591040:0@lo:101: 00010000:00010000:3.0:1788687645.097905:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687645.097914:0:7627:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687645.097986:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591168:0@lo:501: 00000100:00100000:3.0:1788687645.098011:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.098037:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788687645.098051:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839591168 00000100:00100000:3.0:1788687645.098056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839591168 00000100:00100000:3.0:1788687645.098079:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788687645.098085:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839591168:12345-0@lo:501: 00000100:00100000:3.0:1788687645.098292:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839591168:12345-0@lo:501: Request processed in 206us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687645.098300:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788687645.098676:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591168:0@lo:501: 00000100:00100000:3.0:1788687645.098707:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591296:0@lo:503: 00000100:00100000:3.0:1788687645.098746:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.098808:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788687645.101087:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839591296 00000100:00100000:2.0:1788687645.101099:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839591296 00000100:00100000:2.0:1788687645.101187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788687645.101198:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839591296:12345-0@lo:503: 00000100:00100000:2.0:1788687645.101719:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839591296:12345-0@lo:503: Request processed in 522us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687645.101728:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788687645.101851:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591296:0@lo:503: 00000040:00080000:3.0:1788687645.102143:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788687645.102221:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591424:0@lo:502: 00000100:00100000:3.0:1788687645.102267:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.102432:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788687645.102592:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839591424 00000100:00100000:2.0:1788687645.102598:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839591424 00000100:00100000:2.0:1788687645.102640:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788687645.102656:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839591424:12345-0@lo:502: 00000100:00100000:2.0:1788687645.102864:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839591424:12345-0@lo:502: Request processed in 209us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687645.102871:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788687645.102987:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591424:0@lo:502: 00000040:00080000:3.0:1788687645.103223:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788687645.103267:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788687645.103292:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788687645.103341:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788687645.103444:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788687645.103543:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788687645.103582:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788687645.103616:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788687645.103656:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788687645.103692:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788687645.103717:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788687645.103752:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788687645.103779:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788687645.103803:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788687645.103871:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788687645.103903:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788687645.103928:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788687645.103975:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788687645.104012:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788687645.104045:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788687645.104096:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788687645.104137:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788687645.104171:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788687645.104218:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788687645.104251:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788687645.104282:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788687645.104323:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788687645.104350:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788687645.104810:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788687645.104877:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788687645.104915:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788687645.104948:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788687645.104978:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788687645.105024:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788687645.105059:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788687645.105104:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788687645.105136:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788687645.105186:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591552:0@lo:502: 00000100:00100000:3.0:1788687645.105270:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687645.105460:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788687645.105747:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839591552 00000100:00100000:2.0:1788687645.105755:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839591552 00000100:00100000:2.0:1788687645.105859:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788687645.105870:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839591552:12345-0@lo:502: 00000100:00100000:2.0:1788687645.106165:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839591552:12345-0@lo:502: Request processed in 296us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687645.106175:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788687645.106283:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591552:0@lo:502: 00000040:00080000:3.0:1788687645.106661:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788687645.106673:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788687645.107174:0:7639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788687645.107199:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9af3f38b8000) 00000020:00000080:1.0:1788687645.107223:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788687645.107298:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af3ffb81000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788687645.107301:0:7639:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af3ffb81000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788687645.107305:0:7639:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3ffb81000 3 00010000:00080000:1.0:1788687645.107474:0:7639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af3f7b73800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788687645.110775:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788687645.111098:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788687645.111142:0:7639:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788687645.111164:0:7639:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc2ddd83e74448c4f 00000100:00080000:1.0:1788687645.111178:0:7639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788687645.111185:0:7639:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9af3f7b73800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788687645.111246:0:7639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3c5b66d80 x1875574839591680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788687645.111280:0:7639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788687645.111628:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875574839591680:0@lo:38: 00000100:00100000:0.0:1788687645.111700:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687645.111754:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839591680 00000100:00100000:0.0:1788687645.111762:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839591680 00000100:00100000:0.0:1788687645.111798:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788687645.111806:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1875574839591680:12345-0@lo:38: 00010000:00080000:0.0:1788687645.111840:0:5840:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1788687645.111877:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc2ddd83e74448c56 00000004:00100000:0.0:1788687645.111891:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788687645.111927:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9af3fbbfa000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788687645.111982:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875574839591680:12345-0@lo:38: Request processed in 176us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687645.111989:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788687645.112032:0:3309:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c5b66d80 x1875574839591680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788687655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687645.112041:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788687645.112049:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788687645.112057:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788687645.112061:0:3309:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788687645.112064:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f7b73800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788687645.112070:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875574839591680:0@lo:38: 00000040:00080000:0.0:1788687645.112722:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1788687645.112909:0:7640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b64380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7640:1875574839591808:0@lo:901: 00000100:00100000:1.0:1788687645.112961:0:7640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687645.112985:0:7640:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1300 going to sleep for 11 seconds 00000020:01000000:2.0:1788687645.113034:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788687645.113067:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788687645.113089:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687645.113100:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788687645.113146:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788687645.113148:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788687645.113149:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788687645.113151:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788687645.113152:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788687645.113153:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788687645.113154:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788687645.113156:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788687645.113158:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788687645.113160:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788687645.113161:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788687645.113166:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788687645.113173:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788687645.113174:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788687645.113175:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788687645.113176:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788687645.113176:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788687645.113177:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788687645.113178:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788687645.113179:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788687645.113180:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788687645.113180:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788687645.113181:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788687645.113196:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788687645.113203:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591936:0@lo:253: 00000100:00100000:2.0:1788687645.113238:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687645.113273:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c722f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687645.113596:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839591808 00000100:00100000:0.0:1788687645.113604:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839591808 00000100:00100000:0.0:1788687645.113652:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788687645.113663:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7640:x1875574839591808:12345-0@lo:901: 00000100:00100000:0.0:1788687645.114078:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7640:x1875574839591808:12345-0@lo:901: Request processed in 414us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687645.114086:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788687645.114115:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839591936 00000100:00100000:0.0:1788687645.114119:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839591936 00000100:00100000:0.0:1788687645.114144:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788687645.114151:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:7627:x1875574839591936:12345-0@lo:253: 20000000:01000000:0.0:1788687645.114193:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788687645.114209:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1788687645.114730:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788687645.115592:0:7640:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c5b64380 x1875574839591808/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788687661 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687645.115609:0:7640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b64380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7640:1875574839591808:0@lo:901: 20000000:01000000:1.0:1788687645.168314:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788687645.168342:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788687645.168424:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788687645.168431:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788687645.168514:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.168535:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c0030200/0xc2ddd83e74448bae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448ba7 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.168544:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.168592:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c0030200/0xc2ddd83e74448bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448ba7 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.168607:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c0030200/0xc2ddd83e74448bae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448ba7 expref: 14 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687645.168622:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875574839592064:0@lo:104: 00000100:00100000:0.0:1788687645.168696:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687645.168748:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687645.168775:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839592064 00000100:00100000:0.0:1788687645.168783:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839592064 00000100:00100000:0.0:1788687645.168840:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788687645.168849:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:5855:x1875574839592064:12345-0@lo:104: 00010000:00010000:0.0:1788687645.168863:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.168914:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788687645.168935:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:5855:x1875574839592064:12345-0@lo:104: Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687645.168941:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788687645.168985:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875574839592064:0@lo:104: 00010000:00010000:0.0:1788687645.169007:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.169025:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687645.169030:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.169037:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687645.169041:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.169050:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687645.169057:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687645.169063:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788687645.169097:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.169104:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788687645.169123:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.169130:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74448ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687645.169155:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687645.169157:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687645.169159:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687645.169172:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839592192:0@lo:103: 00000100:00100000:0.0:1788687645.169203:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687645.169475:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839592192 00000100:00100000:1.0:1788687645.169502:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839592192 00010000:00010000:1.0:1788687645.169526:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c0030200/0xc2ddd83e74448bae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448ba7 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687645.169554:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788687645.169562:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c690b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:3312:x1875574839592192:12345-0@lo:103: 00010000:00010000:1.0:1788687645.169573:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687645.169578:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c0030200/0xc2ddd83e74448bae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448ba7 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169589:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c0030200/0xc2ddd83e74448bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448ba7 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169616:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c0030200/0xc2ddd83e74448bae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448ba7 expref: 15 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169631:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169639:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788687645.169652:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007377720s 00010000:00010000:1.0:1788687645.169656:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169663:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169670:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169676:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169682:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c0031000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687645.169686:0:5825:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169693:0:5825:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169707:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169726:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687645.169764:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c690b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:3312:x1875574839592192:12345-0@lo:103: Request processed in 203us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687645.169771:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788687645.169834:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169842:0:5855:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687645.169847:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c0031000/0xc2ddd83e74448c5d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687645.169878:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839592192:0@lo:103: 00000100:00100000:2.0:1788687645.182990:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:7627:x1875574839591936:12345-0@lo:253: Request processed in 68827us (69738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687645.183005:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788687645.183100:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:7627:1875574839591936:0@lo:253: 10000000:01000000:3.0:1788687645.183116:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788687645.183120:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788687645.183122:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788687645.183123:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788687645.183124:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788687645.183125:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788687645.183126:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788687645.183128:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788687645.183129:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788687645.183130:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788687645.183132:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788687645.183134:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788687645.183152:0:7627:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788687645.189750:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788687645.189983:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788687645.190202:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788687645.190425:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788687645.190659:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788687645.190915:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00010000:2.0:1788687645.191279:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788687645.192413:0:7627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788687645.426796:0:7627:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788687645.426805:0:7627:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788687645.426858:0:7627:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788687645.426932:0:7627:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788687645.426950:0:7627:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788687645.426983:0:7627:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788687646.214649:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687647.242730:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687648.269594:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687649.288602:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687649.865429:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788687649.865463:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839592320:0@lo:13: 00000100:00100000:1.0:1788687649.865588:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687649.865656:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839592320 00000100:00100000:1.0:1788687649.865664:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839592320 00000100:00100000:1.0:1788687649.865725:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788687649.865746:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839592320:12345-0@lo:13: 00002000:00000024:1.0:1788687649.865780:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687649.865823:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839592320:12345-0@lo:13: Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687649.865829:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788687649.865849:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788687649.865877:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c5b65500 x1875574839592320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687649.865907:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839592320:0@lo:13: 00010000:00010000:2.0:1788687650.310744:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687650.377906:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839592704:0@lo:400: 00000100:00100000:3.0:1788687650.377984:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687650.378052:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788687650.378059:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839592832:0@lo:400: 00000100:00100000:3.0:1788687650.378088:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687650.378130:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839592704 00000100:00100000:3.0:1788687650.378137:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839592704 00000100:00100000:3.0:1788687650.378210:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788687650.378222:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839592704:12345-0@lo:400: 00000100:00100000:3.0:1788687650.378298:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839592704:12345-0@lo:400: Request processed in 79us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687650.378305:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788687650.378331:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839592832 00000100:00100000:3.0:1788687650.378335:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839592832 00000100:00100000:3.0:1788687650.378359:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788687650.378367:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839592832:12345-0@lo:400: 00000100:00100000:3.0:1788687650.378400:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839592832:12345-0@lo:400: Request processed in 34us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687650.378406:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788687650.378424:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788687650.378467:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3414a80 x1875574839592832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687650.378500:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839592832:0@lo:400: 00010000:00080000:3.0:1788687650.378512:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3417800 x1875574839592704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687650.378521:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839592704:0@lo:400: 00000100:00100000:0.0:1788687650.378623:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839592448:0@lo:400: 00000100:00100000:0.0:1788687650.378666:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687650.378699:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839592960:0@lo:400: 00000100:00100000:0.0:1788687650.378734:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687650.378754:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788687650.378760:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839592576:0@lo:400: 00000100:00100000:0.0:1788687650.378781:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687650.378808:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839592960 00000100:00100000:0.0:1788687650.378811:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839592960 00000100:00100000:0.0:1788687650.378840:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839592576 00000100:00100000:0.0:1788687650.378843:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839592576 00000100:00100000:0.0:1788687650.378857:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788687650.378872:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839592960:12345-0@lo:400: 00000100:00100000:0.0:1788687650.378908:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839592960:12345-0@lo:400: Request processed in 37us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687650.378915:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788687650.378928:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788687650.378934:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839592576:12345-0@lo:400: 00000100:00100000:0.0:1788687650.378959:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839592576:12345-0@lo:400: Request processed in 26us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687650.378965:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788687650.378981:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788687650.378995:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3414700 x1875574839592576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687650.379005:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839592576:0@lo:400: 00010000:00080000:0.0:1788687650.379015:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3417480 x1875574839592960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687650.379023:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839592960:0@lo:400: 00000100:00100000:3.0:1788687650.379842:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839592448 00000100:00100000:3.0:1788687650.379850:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839592448 00000100:00100000:3.0:1788687650.379881:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788687650.379888:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3310:x1875574839592448:12345-0@lo:400: 00000100:00100000:3.0:1788687650.379935:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3310:x1875574839592448:12345-0@lo:400: Request processed in 47us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687650.379942:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788687650.379984:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839592448:0@lo:400: 00000001:02000400:3.0:1788687651.213188:0:7981:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788687651.334798:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687652.357662:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687653.382515:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687654.411589:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687654.981692:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839593088:0@lo:13: 00000100:00100000:1.0:1788687654.981779:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788687654.981918:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788687654.981924:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3f39f5000 from 30 10000000:01000000:2.0:1788687654.981929:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788687654.981969:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687654.981981:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687654.981993:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687654.982030:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839593216:0@lo:101: 00000100:00100000:2.0:1788687654.982070:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687654.982104:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839593216 00000100:00100000:2.0:1788687654.982112:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839593216 00000100:00100000:3.0:1788687654.982172:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788687654.982185:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839593216:12345-0@lo:101: 00010000:00010000:3.0:1788687654.982200:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687654.982214:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aad600/0xc2ddd83e74448c6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448c64 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687654.982242:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839593088 00010000:00010000:3.0:1788687654.982243:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aad600/0xc2ddd83e74448c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448c64 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687654.982249:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839593088 00010000:00010000:3.0:1788687654.982260:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aad600/0xc2ddd83e74448c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c64 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687654.982270:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad600, rc 0) 00000100:00100000:1.0:1788687654.982296:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788687654.982307:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839593088:12345-0@lo:13: 00000100:00100000:3.0:1788687654.982314:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839593216:12345-0@lo:101: Request processed in 130us (241us total) trans 0 rc 0/0 00002000:00000024:1.0:1788687654.982335:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687654.982379:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839593088:12345-0@lo:13: Request processed in 75us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687654.982388:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788687654.982413:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788687654.982434:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c81ea300 going to sleep for 11 seconds 00000100:00100000:1.0:1788687654.982470:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839593216:0@lo:101: 00010000:00010000:1.0:1788687654.982508:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687654.982521:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687654.982584:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839593344:0@lo:501: 00000100:00100000:1.0:1788687654.982615:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687654.982641:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bf600 going to sleep for 11 seconds 00000100:00100000:1.0:1788687654.982656:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839593344 00000100:00100000:1.0:1788687654.982660:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839593344 00000100:00100000:3.0:1788687654.985656:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788687654.986651:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788687654.986676:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839593344:12345-0@lo:501: 00000100:00100000:1.0:1788687654.989687:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839593344:12345-0@lo:501: Request processed in 3008us (7062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687654.989703:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1788687654.989783:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c5b65500 x1875574839593088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687654.989811:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839593088:0@lo:13: 00000100:00100000:0.0:1788687654.992673:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839593344:0@lo:501: 00000100:00100000:0.0:1788687654.992741:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839593472:0@lo:503: 00000100:00100000:0.0:1788687654.992822:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687654.992864:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788687654.992888:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839593472 00000100:00100000:0.0:1788687654.992895:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839593472 00000100:00100000:0.0:1788687654.992948:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788687654.992967:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839593472:12345-0@lo:503: 00000100:00100000:0.0:1788687654.993421:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839593472:12345-0@lo:503: Request processed in 454us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687654.993430:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788687654.993522:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839593472:0@lo:503: 00000100:00100000:0.0:1788687654.993758:0:8133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8133:1875574839593600:0@lo:502: 00000100:00100000:0.0:1788687654.993796:0:8133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687654.993821:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839593600 00000100:00100000:0.0:1788687654.993825:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839593600 00000100:00100000:0.0:1788687654.993849:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788687654.993855:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:8133:x1875574839593600:12345-0@lo:502: 00000100:00100000:0.0:1788687654.994077:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:8133:x1875574839593600:12345-0@lo:502: Request processed in 221us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687654.994084:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788687654.994117:0:8133:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788687654.994130:0:8133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8133:1875574839593600:0@lo:502: 00000100:00100000:0.0:1788687654.994175:0:8133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8133:1875574839593728:0@lo:502: 00000100:00100000:0.0:1788687654.994206:0:8133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687654.994227:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839593728 00000100:00100000:0.0:1788687654.994231:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839593728 00000100:00100000:0.0:1788687654.994251:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788687654.994257:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:8133:x1875574839593728:12345-0@lo:502: 00000100:00100000:0.0:1788687654.994377:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:8133:x1875574839593728:12345-0@lo:502: Request processed in 120us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687654.994384:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788687654.994418:0:8133:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788687654.994430:0:8133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8133:1875574839593728:0@lo:502: 00000040:00080000:0.0:1788687654.994449:0:8133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788687654.994540:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788687654.994556:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788687654.994565:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687654.994576:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687654.994586:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788687654.994589:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788687654.994592:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788687654.994617:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687654.994626:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687654.994650:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687654.994663:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839593856:0@lo:101: 00000100:00100000:0.0:1788687654.994692:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687654.994706:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788687654.994718:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839593856 00000100:00100000:0.0:1788687654.994722:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839593856 00000100:00100000:0.0:1788687654.994743:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788687654.994750:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839593856:12345-0@lo:101: 00010000:00010000:0.0:1788687654.994765:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687654.994778:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448c79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448c72 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687654.994799:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448c72 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687654.994809:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c72 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687654.994819:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c0030600, rc 0) 00000100:00100000:0.0:1788687654.994847:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839593856:12345-0@lo:101: Request processed in 98us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687654.994853:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788687654.994882:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839593856:0@lo:101: 00010000:00010000:0.0:1788687654.994895:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687654.994904:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687654.994940:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839593984:0@lo:501: 00000100:00100000:0.0:1788687654.994962:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687654.994976:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788687654.994988:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839593984 00000100:00100000:0.0:1788687654.994991:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839593984 00000100:00100000:0.0:1788687654.995011:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788687654.995018:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839593984:12345-0@lo:501: 00000100:00100000:0.0:1788687654.995253:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839593984:12345-0@lo:501: Request processed in 234us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687654.995260:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788687654.997468:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839593984:0@lo:501: 00000100:00100000:2.0:1788687654.997556:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839594112:0@lo:503: 00000100:00100000:2.0:1788687654.997645:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687654.997691:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c81ea300 going to sleep for 11 seconds 00000100:00100000:1.0:1788687654.998299:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839594112 00000100:00100000:1.0:1788687654.998312:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839594112 00000100:00100000:1.0:1788687654.998395:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788687654.998408:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839594112:12345-0@lo:503: 00000100:00100000:1.0:1788687654.999285:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839594112:12345-0@lo:503: Request processed in 875us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687654.999295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788687654.999396:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839594112:0@lo:503: 00000100:00100000:2.0:1788687655.003161:0:8135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8135:1875574839594240:0@lo:502: 00000100:00100000:2.0:1788687655.003256:0:8135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687655.003312:0:8135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c81ea300 going to sleep for 11 seconds 00000100:00100000:1.0:1788687655.003423:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839594240 00000100:00100000:1.0:1788687655.003434:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839594240 00000100:00100000:1.0:1788687655.003707:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788687655.003719:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:8135:x1875574839594240:12345-0@lo:502: 00000100:00100000:1.0:1788687655.004314:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:8135:x1875574839594240:12345-0@lo:502: Request processed in 594us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687655.004326:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788687655.004682:0:8135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8135:1875574839594240:0@lo:502: 00000020:01000000:2.0:1788687655.004720:0:8135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788687655.004730:0:8135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687655.004733:0:8135:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788687655.004739:0:8135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788687655.004741:0:8135:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788687655.004767:0:8135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8135:1875574839594368:0@lo:502: 00000100:00100000:2.0:1788687655.004813:0:8135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687655.005073:0:8135:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c991e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788687655.005705:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839594368 00000100:00100000:1.0:1788687655.005714:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839594368 00000100:00100000:1.0:1788687655.005764:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788687655.005773:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:8135:x1875574839594368:12345-0@lo:502: 00000100:00100000:1.0:1788687655.007030:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:8135:x1875574839594368:12345-0@lo:502: Request processed in 1252us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687655.007052:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788687655.014802:0:8135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8135:1875574839594368:0@lo:502: 00000020:01000000:2.0:1788687655.014869:0:8135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788687655.014884:0:8135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687655.014886:0:8135:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788687655.014905:0:8135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788687655.015255:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788687655.015280:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788687655.015292:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687655.015304:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687655.015315:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788687655.015318:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3e6e77800 from 30 10000000:01000000:1.0:1788687655.015321:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788687655.015358:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687655.015366:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687655.015376:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687655.015793:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839594496:0@lo:101: 00000100:00100000:1.0:1788687655.015945:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687655.015998:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bf000 going to sleep for 11 seconds 00000100:00100000:2.0:1788687655.016050:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839594496 00000100:00100000:2.0:1788687655.016059:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839594496 00000100:00100000:2.0:1788687655.016111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788687655.016120:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839594496:12345-0@lo:101: 00010000:00010000:2.0:1788687655.016234:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687655.016249:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448c87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448c80 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687655.016275:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448c80 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687655.016287:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c80 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687655.016297:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d9800, rc 0) 00000100:00100000:2.0:1788687655.016382:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839594496:12345-0@lo:101: Request processed in 262us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687655.016390:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788687655.025654:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839594496:0@lo:101: 00010000:00010000:1.0:1788687655.025689:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687655.025702:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687655.025798:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839594624:0@lo:501: 00000100:00100000:1.0:1788687655.026018:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687655.026103:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bf000 going to sleep for 11 seconds 00000100:00100000:3.0:1788687655.035586:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839594624 00000100:00100000:3.0:1788687655.035602:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839594624 00000100:00100000:3.0:1788687655.035683:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788687655.035694:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839594624:12345-0@lo:501: 00000100:00100000:3.0:1788687655.036046:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839594624:12345-0@lo:501: Request processed in 354us (10028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687655.036054:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788687655.036895:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839594624:0@lo:501: 00000100:00100000:0.0:1788687655.036970:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839594752:0@lo:503: 00000100:00100000:0.0:1788687655.037036:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687655.037087:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788687655.038575:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839594752 00000100:00100000:3.0:1788687655.038588:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839594752 00000100:00100000:3.0:1788687655.038658:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788687655.038670:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839594752:12345-0@lo:503: 00000100:00100000:3.0:1788687655.038934:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839594752:12345-0@lo:503: Request processed in 267us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687655.038943:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788687655.039005:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839594752:0@lo:503: 00000100:00100000:0.0:1788687655.041650:0:8138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8138:1875574839594880:0@lo:502: 00000100:00100000:0.0:1788687655.041731:0:8138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687655.041777:0:8138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788687655.042223:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839594880 00000100:00100000:1.0:1788687655.042231:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839594880 00000100:00100000:1.0:1788687655.042284:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788687655.042295:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:8138:x1875574839594880:12345-0@lo:502: 00000100:00100000:1.0:1788687655.042592:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:8138:x1875574839594880:12345-0@lo:502: Request processed in 298us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687655.042600:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788687655.042744:0:8138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8138:1875574839594880:0@lo:502: 00000100:00100000:0.0:1788687655.042803:0:8138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8138:1875574839595008:0@lo:502: 00000100:00100000:0.0:1788687655.042845:0:8138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687655.042876:0:8138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687655.042899:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839595008 00000100:00100000:1.0:1788687655.042904:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839595008 00000100:00100000:1.0:1788687655.042937:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788687655.042946:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:8138:x1875574839595008:12345-0@lo:502: 00000100:00100000:1.0:1788687655.043083:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:8138:x1875574839595008:12345-0@lo:502: Request processed in 138us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687655.043089:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788687655.045809:0:8138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8138:1875574839595008:0@lo:502: 00000040:00080000:0.0:1788687655.045858:0:8138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788687655.046246:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788687655.046268:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788687655.046279:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687655.046290:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687655.046301:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788687655.046304:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af3e6e77800 from 5 10000000:01000000:3.0:1788687655.046307:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788687655.046352:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687655.046361:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687655.046369:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687655.046387:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839595136:0@lo:101: 00000100:00100000:3.0:1788687655.046473:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687655.046539:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f3d76240 going to sleep for 11 seconds 00000100:00100000:0.0:1788687655.047717:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839595136 00000100:00100000:0.0:1788687655.047729:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839595136 00000100:00100000:0.0:1788687655.047797:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788687655.047807:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839595136:12345-0@lo:101: 00010000:00010000:0.0:1788687655.047823:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687655.047843:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448c95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448c8e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687655.047872:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448c8e expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687655.047899:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c8e expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687655.047909:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c0031800, rc 0) 00000100:00100000:0.0:1788687655.047998:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839595136:12345-0@lo:101: Request processed in 193us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687655.048006:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788687655.048211:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839595136:0@lo:101: 00010000:00010000:3.0:1788687655.048237:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687655.048249:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687655.048312:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839595264:0@lo:256: 00000100:00100000:3.0:1788687655.048354:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687655.048426:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f3d76240 going to sleep for 11 seconds 00000100:00100000:1.0:1788687655.050818:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839595264 00000100:00100000:1.0:1788687655.050831:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839595264 00000100:00100000:1.0:1788687655.050891:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788687655.050902:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839595264:12345-0@lo:256: 20000000:01000000:1.0:1788687655.050927:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788687655.050944:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788687655.050947:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788687655.051760:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839595264:12345-0@lo:256: Request processed in 856us (3402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687655.051786:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788687655.051793:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839595264:0@lo:256: 10000000:01000000:0.0:1788687655.051858:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788687655.051869:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687655.051879:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687655.051888:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788687655.051891:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788687655.051893:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788687655.051923:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687655.051931:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687655.051938:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687655.051956:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839595392:0@lo:101: 00000100:00100000:0.0:1788687655.052009:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687655.052051:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce540 going to sleep for 11 seconds 00000100:00100000:1.0:1788687655.052110:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839595392 00000100:00100000:1.0:1788687655.052116:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839595392 00000100:00100000:1.0:1788687655.052152:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788687655.052159:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839595392:12345-0@lo:101: 00010000:00010000:1.0:1788687655.052169:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687655.052182:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448ca3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448c9c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687655.052206:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448c9c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687655.052217:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c9c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687655.052226:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ede00, rc 0) 00000100:00100000:1.0:1788687655.052254:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839595392:12345-0@lo:101: Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687655.052260:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788687655.052333:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839595392:0@lo:101: 00010000:00010000:0.0:1788687655.052348:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687655.052359:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687655.052410:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839595520:0@lo:501: 00000100:00100000:0.0:1788687655.052452:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687655.052502:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce540 going to sleep for 11 seconds 00000100:00100000:1.0:1788687655.052549:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839595520 00000100:00100000:1.0:1788687655.052553:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839595520 00000100:00100000:1.0:1788687655.052580:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788687655.052587:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839595520:12345-0@lo:501: 00000100:00100000:1.0:1788687655.052905:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839595520:12345-0@lo:501: Request processed in 317us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687655.052912:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788687655.053077:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839595520:0@lo:501: 00000100:00100000:0.0:1788687655.053112:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839595648:0@lo:503: 00000100:00100000:0.0:1788687655.053156:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687655.053187:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce540 going to sleep for 11 seconds 00000100:00100000:1.0:1788687655.053235:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839595648 00000100:00100000:1.0:1788687655.053240:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839595648 00000100:00100000:1.0:1788687655.053278:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788687655.053285:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839595648:12345-0@lo:503: 00000100:00100000:1.0:1788687655.053623:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839595648:12345-0@lo:503: Request processed in 337us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687655.053639:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788687655.053806:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839595648:0@lo:503: 00000100:00100000:0.0:1788687655.054261:0:8139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8139:1875574839595776:0@lo:502: 00000100:00100000:0.0:1788687655.054306:0:8139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687655.054340:0:8139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce540 going to sleep for 11 seconds 00000100:00100000:1.0:1788687655.054384:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839595776 00000100:00100000:1.0:1788687655.054389:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839595776 00000100:00100000:1.0:1788687655.054422:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788687655.054429:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8139:x1875574839595776:12345-0@lo:502: 00000100:00100000:1.0:1788687655.054950:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8139:x1875574839595776:12345-0@lo:502: Request processed in 518us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687655.054959:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788687655.058840:0:8139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8139:1875574839595776:0@lo:502: 00000020:01000000:1.0:1788687655.060140:0:8139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788687655.060153:0:8139:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788687655.060162:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687655.060164:0:8139:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788687655.060170:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788687655.060175:0:8139:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:1.0:1788687655.060204:0:8139:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788687655.060207:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788687655.060224:0:8139:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9af3f38bcd40) 00000020:00000080:1.0:1788687655.060250:0:8139:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788687655.060257:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788687655.060346:0:8139:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788687655.060353:0:8139:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788687655.060360:0:8139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74448cb1 00010000:00080000:1.0:1788687655.060398:0:8139:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af3c3152000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788687655.061021:0:8139:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788687655.062540:0:8139:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788687655.062575:0:8139:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788687655.063111:0:8139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788687655.066096:0:8139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788687655.066176:0:8139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788687655.066245:0:8139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788687655.068843:0:8140:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687655.068853:0:8140:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788687655.069423:0:8139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788687655.069436:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788687655.069475:0:8139:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788687655.069580:0:8139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2ddd83e74448cb8 00000100:00080000:3.0:1788687655.069801:0:8139:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788687655.069812:0:8139:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9af3c3152000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788687655.069861:0:8139:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3f3417800 x1875574839595904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788687655.069927:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839595904:0@lo:8: 00000100:00100000:0.0:1788687655.070011:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788687655.070076:0:8139:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788687655.070171:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839596032:0@lo:400: 00000100:00100000:3.0:1788687655.070202:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687655.070225:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788687655.070231:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839596160:0@lo:400: 00000100:00100000:3.0:1788687655.070255:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687655.070288:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839596288:0@lo:400: 00000100:00100000:1.0:1788687655.070304:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839595904 00000100:00100000:1.0:1788687655.070313:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839595904 00000100:00100000:3.0:1788687655.070319:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687655.070355:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788687655.070366:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1875574839595904:12345-0@lo:8: 00010000:00080000:1.0:1788687655.070396:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:01000000:3.0:1788687655.070415:0:8139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687655.070422:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687655.070430:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2ddd83e74448cbf 00000020:00000080:3.0:1788687655.070431:0:8139:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788687655.070438:0:8139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687655.070443:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687655.070445:0:8139:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788687655.070449:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788687655.070451:0:8139:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00002000:00100000:1.0:1788687655.070460:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9af3c3152800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788687655.070467:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788687655.070472:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788687655.070475:0:8139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8139:1875574839596416:0@lo:502: 00000100:00100000:3.0:1788687655.070540:0:8139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687655.070562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839596416 00000100:00100000:3.0:1788687655.070565:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839596416 00002000:00100000:1.0:1788687655.070662:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788687655.070704:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788687655.070715:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8139:x1875574839596416:12345-0@lo:502: 00002000:00080000:1.0:1788687655.070872:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788687655.070900:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9af3c3157000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788687655.071556:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8139:x1875574839596416:12345-0@lo:502: Request processed in 841us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687655.071566:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788687655.072160:0:8139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f3d76e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687655.072187:0:8139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8139:1875574839596416:0@lo:502: 00000020:01000000:3.0:1788687655.072225:0:8139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687655.072232:0:8139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687655.072234:0:8139:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788687655.072240:0:8139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788687655.072321:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788687655.072343:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788687655.072355:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687655.072367:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687655.072378:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788687655.072388:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af3e0230000 from 1 10000000:01000000:3.0:1788687655.072392:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788687655.072425:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687655.072434:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687655.072444:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687655.072463:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839596544:0@lo:101: 00000100:00100000:3.0:1788687655.072531:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687655.072557:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f3d76e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788687655.076609:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839596544 00000100:00100000:2.0:1788687655.076626:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839596544 00000100:00100000:2.0:1788687655.076697:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788687655.076708:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839596544:12345-0@lo:101: 00010000:00010000:2.0:1788687655.076726:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687655.076749:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448ccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448cc6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687655.076782:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448cc6 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687655.076814:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448cc6 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687655.076823:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d8c00, rc 0) 00000100:00100000:2.0:1788687655.076911:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839596544:12345-0@lo:101: Request processed in 204us (4379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687655.076917:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788687655.076954:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839596032 00000100:00100000:2.0:1788687655.076959:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839596032 00000100:00100000:2.0:1788687655.076981:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839596160 00000100:00100000:2.0:1788687655.076984:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839596160 00000100:00100000:2.0:1788687655.077009:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839596288 00000100:00100000:2.0:1788687655.077012:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839596288 00000100:00100000:2.0:1788687655.077025:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788687655.077031:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839596032:12345-0@lo:400: 00000100:00100000:2.0:1788687655.077072:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839596032:12345-0@lo:400: Request processed in 41us (6869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687655.077078:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788687655.077088:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788687655.077094:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839596160:12345-0@lo:400: 00000100:00100000:2.0:1788687655.077118:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839596160:12345-0@lo:400: Request processed in 25us (6863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687655.077124:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788687655.077149:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788687655.077155:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839596288:12345-0@lo:400: 00000100:00100000:2.0:1788687655.077187:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839596288:12345-0@lo:400: Request processed in 33us (6869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687655.077199:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788687655.077223:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788687655.077262:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3415c00 x1875574839596160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687655.077277:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839596160:0@lo:400: 00010000:00080000:2.0:1788687655.077290:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3414a80 x1875574839596032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687655.077299:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839596032:0@lo:400: 00010000:00080000:2.0:1788687655.077352:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3414000 x1875574839596288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687655.077362:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839596288:0@lo:400: 00000100:00100000:2.0:1788687655.077390:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839596544:0@lo:101: 00010000:00010000:2.0:1788687655.077411:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687655.077420:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687655.077537:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839596672:0@lo:501: 00000100:00100000:2.0:1788687655.077573:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687655.077609:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8625a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788687655.077646:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839596672 00000100:00100000:2.0:1788687655.077650:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839596672 00000100:00100000:2.0:1788687655.077669:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788687655.077674:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839596672:12345-0@lo:501: 00000100:00100000:2.0:1788687655.077957:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839596672:12345-0@lo:501: Request processed in 282us (383us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788687655.077964:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788687655.077994:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839596672:0@lo:501: 10000000:01000000:2.0:1788687655.078016:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788687655.078023:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687655.078031:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687655.078364:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875574839595904:12345-0@lo:8: Request processed in 7997us (8350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687655.078373:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788687655.086864:0:3309:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3417800 x1875574839595904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788687665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687655.086900:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788687655.086912:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788687655.086923:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788687655.086929:0:3309:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788687655.086933:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3c3152000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788687655.087280:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788687655.087292:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839595904:0@lo:8: 00000004:00080000:1.0:1788687655.090372:0:8140:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788687655.090623:0:8140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 200781141766ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788687655.190250:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788687655.255114:0:8141:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788687655.255153:0:8141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8141:1875574839596928:0@lo:7: 00000100:00100000:2.0:1788687655.255234:0:8141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687655.255293:0:8141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e8c9a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788687655.255327:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687655.255339:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839596800:0@lo:13: 00000100:00100000:2.0:1788687655.255368:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687655.255409:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839596800 00000100:00100000:2.0:1788687655.255419:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839596800 00000100:00100000:2.0:1788687655.255518:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788687655.255529:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839596800:12345-0@lo:13: 00002000:00000024:2.0:1788687655.255569:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788687655.255623:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839596800:12345-0@lo:13: Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687655.255644:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788687655.255684:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788687655.255722:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f40b8000 x1875574839596800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687655.255745:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839596800:0@lo:13: 00000100:00100000:3.0:1788687655.256952:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839596928 00000100:00100000:3.0:1788687655.256962:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839596928 00000100:00100000:3.0:1788687655.259037:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788687655.259055:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8141:x1875574839596928:12345-0@lo:7: 00002000:00080000:3.0:1788687655.273864:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788687655.273874:0:6686:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788687655.274055:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8141:x1875574839596928:12345-0@lo:7: Request processed in 15001us (18817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687655.274066:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788687655.276325:0:8141:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f40b8a80 x1875574839596928/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788687671 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687655.276348:0:8141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8141:1875574839596928:0@lo:7: 00000004:00080000:2.0:1788687655.276365:0:8141:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788687655.279387:0:8141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3417100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8141:1875574839597056:0@lo:5: 00000100:00100000:3.0:1788687655.279469:0:8141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687655.279549:0:8141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f3d76900 going to sleep for 11 seconds 00000100:00100000:2.0:1788687655.280279:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839597056 00000100:00100000:2.0:1788687655.280288:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839597056 00000100:00100000:2.0:1788687655.280341:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788687655.280351:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8141:x1875574839597056:12345-0@lo:5: 00002000:00080000:2.0:1788687655.280383:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788687655.280387:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788687655.280793:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8141:x1875574839597056:12345-0@lo:5: Request processed in 443us (1323us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788687655.280801:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788687655.281288:0:8141:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3417100 x1875574839597056/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788687671 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687655.281306:0:8141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3417100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8141:1875574839597056:0@lo:5: 00000004:00080000:3.0:1788687655.281326:0:8141:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788687655.281363:0:8141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3416d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8141:1875574839597184:0@lo:700: 00000100:00100000:3.0:1788687655.281398:0:8141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687655.281428:0:8141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f3d76900 going to sleep for 11 seconds 00000100:00100000:2.0:1788687655.281496:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839597184 00000100:00100000:2.0:1788687655.281501:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839597184 00000100:00100000:2.0:1788687655.281541:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788687655.281548:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8141:x1875574839597184:12345-0@lo:700: 00000100:00100000:2.0:1788687655.281577:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1875574839597312:0@lo:700: 00000100:00100000:2.0:1788687655.281614:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687655.281643:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e8c9a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788687655.281658:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839597312 00000100:00100000:2.0:1788687655.281661:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839597312 00000100:00100000:2.0:1788687655.281687:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788687655.281699:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1875574839597312:12345-0@lo:700: 40000000:02000000:2.0:1788687655.351963:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788687655.367345:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1875574839597312:12345-0@lo:700: Request processed in 85631us (85715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687655.367432:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788687655.367575:0:6695:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f40b8a80 x1875574839597312/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788687671 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687655.367593:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1875574839597312:0@lo:700: 40000000:02000000:0.0:1788687655.367688:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1788687655.425535:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8141:x1875574839597184:12345-0@lo:700: Request processed in 143975us (144123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687655.425553:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:3.0:1788687655.425655:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788687655.425670:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:1.0:1788687655.425753:0:8141:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3416d80 x1875574839597184/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788687671 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687655.425769:0:8141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3416d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8141:1875574839597184:0@lo:700: 00010000:00010000:0.0:1788687655.430248:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:3.0:1788687655.449402:0:8141:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788687655.455762:0:8141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8141:1875574839597440:0@lo:5: 00000100:00100000:2.0:1788687655.455937:0:8141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687655.456283:0:8141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8325180 going to sleep for 11 seconds 00000100:00100000:3.0:1788687655.456450:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839597440 00000100:00100000:3.0:1788687655.456461:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839597440 00000100:00100000:3.0:1788687655.456564:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788687655.456576:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8141:x1875574839597440:12345-0@lo:5: 00002000:00080000:1.0:1788687655.462648:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788687655.462680:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788687655.467381:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8141:x1875574839597440:12345-0@lo:5: Request processed in 10798us (11435us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788687655.467395:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788687655.467523:0:8141:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f40bb800 x1875574839597440/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788687671 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687655.467539:0:8141:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788687655.467558:0:8141:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9af3f40bb800 x1875574839597440/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788687671 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687655.467570:0:8141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8141:1875574839597440:0@lo:5: 00000004:00080000:2.0:1788687655.467585:0:8141:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:3.0:1788687656.289832:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788687656.458942:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687657.478507:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687657.837312:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687657.837632:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819651968 00000100:00100000:2.0:1788687657.837643:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819651968 00000100:00100000:2.0:1788687657.837693:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:2.0:1788687657.837701:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2345:x1875574819651968:12345-192.168.204.26@tcp:250: 00010000:00080000:2.0:1788687657.837731:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6@192.168.204.26@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1788687657.837759:0:5831:0:(genops.c:1385:class_connect()) connect: client eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6, cookie 0xc2ddd83e74448cd4 00000100:00080000:2.0:1788687657.837911:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9af3c83c2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788687657.838019:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+5:2345:x1875574819651968:12345-192.168.204.26@tcp:250: Request processed in 317us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687657.838028:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:0.0:1788687657.845677:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687657.845895:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819651840 00000100:00100000:3.0:1788687657.845906:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819651840 00000100:00100000:3.0:1788687657.845974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:3.0:1788687657.846180:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+5:5572:x1875574819651840:12345-192.168.204.26@tcp:101: 00010000:00010000:3.0:1788687657.846199:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687657.846219:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74448cdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462a1d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687657.846255:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74448cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a1d expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687657.846268:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74448cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a1d expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687657.846279:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac600, rc 0) 00000100:00100000:3.0:1788687657.846439:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+6:5572:x1875574819651840:12345-192.168.204.26@tcp:101: Request processed in 454us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687657.846447:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:1.0:1788687657.860777:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687657.861003:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819652096 00000100:00100000:2.0:1788687657.861015:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819652096 00000100:00100000:2.0:1788687657.861093:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:2.0:1788687657.861114:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+6:5572:x1875574819652096:12345-192.168.204.26@tcp:501: 00000100:00100000:2.0:1788687657.861550:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+6:5572:x1875574819652096:12345-192.168.204.26@tcp:501: Request processed in 438us (782us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788687657.861558:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:1.0:1788687657.864426:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687657.864689:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819652224 00000100:00100000:3.0:1788687657.864700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819652224 00000100:00100000:3.0:1788687657.864837:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:3.0:1788687657.864850:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+6:5572:x1875574819652224:12345-192.168.204.26@tcp:101: 00010000:00010000:3.0:1788687657.864873:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687657.864898:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74448ce2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462a24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687657.864935:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74448ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a24 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687657.864947:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74448ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a24 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687657.864958:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad400, rc 0) 00000100:00100000:3.0:1788687657.865179:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+7:5572:x1875574819652224:12345-192.168.204.26@tcp:101: Request processed in 331us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687657.865188:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:3.0:1788687657.871604:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687657.873545:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819652352 00000100:00100000:0.0:1788687657.873560:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819652352 00000100:00100000:0.0:1788687657.873724:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:0.0:1788687657.873747:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+7:5572:x1875574819652352:12345-192.168.204.26@tcp:501: 00000100:00100000:0.0:1788687657.874341:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:5572:x1875574819652352:12345-192.168.204.26@tcp:501: Request processed in 605us (2744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687657.874351:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:1.0:1788687657.893853:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687657.893939:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819652480 00000100:00100000:2.0:1788687657.893948:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819652480 00000100:00100000:2.0:1788687657.893992:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:2.0:1788687657.894011:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:5572:x1875574819652480:12345-192.168.204.26@tcp:503: 00000100:00100000:2.0:1788687657.894385:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:5572:x1875574819652480:12345-192.168.204.26@tcp:503: Request processed in 383us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687657.894394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:1.0:1788687657.903310:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687657.903715:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819652608 00000100:00100000:2.0:1788687657.903727:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819652608 00000100:00100000:2.0:1788687657.903789:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:2.0:1788687657.903799:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:5590:x1875574819652608:12345-192.168.204.26@tcp:502: 00000100:00100000:2.0:1788687657.907747:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:5590:x1875574819652608:12345-192.168.204.26@tcp:502: Request processed in 3935us (4438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687657.907764:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:0.0:1788687657.938753:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687657.938837:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819652736 00000100:00100000:3.0:1788687657.938848:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819652736 00000100:00100000:3.0:1788687657.938911:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:3.0:1788687657.938922:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:5590:x1875574819652736:12345-192.168.204.26@tcp:502: 00000100:00100000:3.0:1788687657.941722:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:5590:x1875574819652736:12345-192.168.204.26@tcp:502: Request processed in 2787us (2965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687657.941762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:1.0:1788687657.956289:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687657.956390:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819652864 00000100:00100000:2.0:1788687657.956400:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819652864 00000100:00100000:2.0:1788687657.956476:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:2.0:1788687657.956526:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:5572:x1875574819652864:12345-192.168.204.26@tcp:101: 00010000:00010000:2.0:1788687657.956546:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687657.956567:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d9400/0xc2ddd83e74448ce9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462a4e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687657.956612:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d9400/0xc2ddd83e74448ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a4e expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687657.956624:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d9400/0xc2ddd83e74448ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a4e expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687657.956634:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d9400, rc 0) 00000100:00100000:2.0:1788687657.956695:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:5572:x1875574819652864:12345-192.168.204.26@tcp:101: Request processed in 172us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687657.956703:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:2.0:1788687657.967194:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687657.967403:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819652992 00000100:00100000:3.0:1788687657.967416:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819652992 00000100:00100000:1.0:1788687657.967610:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:1.0:1788687657.967624:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:5572:x1875574819652992:12345-192.168.204.26@tcp:256: 20000000:01000000:1.0:1788687657.967660:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788687657.967696:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788687657.967700:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788687657.967703:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788687657.967706:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788687657.973691:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:5572:x1875574819652992:12345-192.168.204.26@tcp:256: Request processed in 6059us (6668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687657.973706:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:2.0:1788687657.981604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687657.981802:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819653120 00000100:00100000:0.0:1788687657.981812:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819653120 00000100:00100000:0.0:1788687657.981876:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:0.0:1788687657.982244:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:5572:x1875574819653120:12345-192.168.204.26@tcp:101: 00010000:00010000:0.0:1788687657.982263:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687657.982282:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c0030400/0xc2ddd83e74448cf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462a55 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687657.982310:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c0030400/0xc2ddd83e74448cf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a55 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687657.982323:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c0030400/0xc2ddd83e74448cf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a55 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687657.982333:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c0030400, rc 0) 00000100:00100000:0.0:1788687657.982399:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5572:x1875574819653120:12345-192.168.204.26@tcp:101: Request processed in 159us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687657.990330:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:2.0:1788687657.992748:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687657.992884:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819653248 00000100:00100000:3.0:1788687657.992894:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819653248 00000100:00100000:3.0:1788687657.992950:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:3.0:1788687657.992959:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5572:x1875574819653248:12345-192.168.204.26@tcp:501: 00000100:00100000:3.0:1788687657.993657:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5572:x1875574819653248:12345-192.168.204.26@tcp:501: Request processed in 696us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687657.993667:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:1.0:1788687657.999676:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687657.999777:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819653376 00000100:00100000:0.0:1788687657.999787:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819653376 00000100:00100000:0.0:1788687657.999851:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:0.0:1788687657.999863:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5572:x1875574819653376:12345-192.168.204.26@tcp:503: 00000100:00100000:0.0:1788687658.000303:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5572:x1875574819653376:12345-192.168.204.26@tcp:503: Request processed in 440us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687658.000312:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:2.0:1788687658.005446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687658.006743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819653504 00000100:00100000:3.0:1788687658.006756:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819653504 00000100:00100000:3.0:1788687658.006830:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:3.0:1788687658.006841:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5595:x1875574819653504:12345-192.168.204.26@tcp:502: 00000100:00100000:3.0:1788687658.007155:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5595:x1875574819653504:12345-192.168.204.26@tcp:502: Request processed in 315us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687658.007164:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:2.0:1788687658.010521:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687658.013808:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819653632 00000100:00100000:1.0:1788687658.013825:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819653632 00000100:00100000:1.0:1788687658.013916:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:1.0:1788687658.013929:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5595:x1875574819653632:12345-192.168.204.26@tcp:502: 00000100:00100000:1.0:1788687658.014465:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5595:x1875574819653632:12345-192.168.204.26@tcp:502: Request processed in 537us (3989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687658.014475:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:1.0:1788687658.033526:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687658.034513:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819653760 00000100:00100000:2.0:1788687658.034525:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819653760 00000100:00100000:2.0:1788687658.034608:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:2.0:1788687658.034616:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2345:x1875574819653760:12345-192.168.204.26@tcp:38: 00010000:00080000:2.0:1788687658.034647:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1788687658.034704:0:5841:0:(genops.c:1385:class_connect()) connect: client bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f, cookie 0xc2ddd83e74448cf7 00000004:00100000:2.0:1788687658.034859:0:5841:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788687658.034879:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788687658.099033:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9af3fbbfd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788687658.099120:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2345:x1875574819653760:12345-192.168.204.26@tcp:38: Request processed in 64502us (65643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687658.099131:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00010000:00010000:1.0:1788687658.504917:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687659.110841:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687659.110888:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687659.110988:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819653888 00000100:00100000:3.0:1788687659.110999:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819653888 00000100:00100000:3.0:1788687659.111081:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819654016 00000100:00100000:3.0:1788687659.111085:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819654016 00000100:00100000:3.0:1788687659.111102:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:3.0:1788687659.111111:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:0:x1875574819653888:12345-192.168.204.26@tcp:41: 00000004:00000024:3.0:1788687659.111171:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788687659.111244:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:0:x1875574819653888:12345-192.168.204.26@tcp:41: Request processed in 134us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687659.111252:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:3.0:1788687659.111268:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:3.0:1788687659.111276:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:5572:x1875574819654016:12345-192.168.204.26@tcp:41: 00000004:00000024:3.0:1788687659.111286:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788687659.111307:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:5572:x1875574819654016:12345-192.168.204.26@tcp:41: Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687659.111312:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00080000:2.0:1788687659.111805:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687659.114661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687659.114748:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819654144 00000100:00100000:1.0:1788687659.114759:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819654144 00000100:00100000:1.0:1788687659.114823:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:1.0:1788687659.114835:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:5572:x1875574819654144:12345-192.168.204.26@tcp:40: 00000100:00100000:1.0:1788687659.114936:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:5572:x1875574819654144:12345-192.168.204.26@tcp:40: Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687659.114945:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:1.0:1788687659.118759:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687659.118850:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687659.118881:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687659.118922:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687659.118952:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819654272 00000100:00100000:1.0:1788687659.118962:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819654272 00000100:00100000:1.0:1788687659.119008:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819654400 00000100:00100000:1.0:1788687659.119012:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819654400 00000100:00100000:1.0:1788687659.119025:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:1.0:1788687659.119034:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875574819654272:12345-192.168.204.26@tcp:8: 00010000:00080000:1.0:1788687659.119193:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1788687659.119227:0:6687:0:(genops.c:1385:class_connect()) connect: client bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f, cookie 0xc2ddd83e74448cfe 00002000:00100000:1.0:1788687659.119240:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f/ffff9af3c3157800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788687659.119265:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788687659.119643:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788687659.119675:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9af3c3151800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687659.119739:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2345:x1875574819654272:12345-192.168.204.26@tcp:8: Request processed in 704us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687659.119747:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:1.0:1788687659.119766:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:1.0:1788687659.119786:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875574819654400:12345-192.168.204.26@tcp:8: 00010000:00080000:1.0:1788687659.119802:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1788687659.119819:0:6687:0:(genops.c:1385:class_connect()) connect: client bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f, cookie 0xc2ddd83e74448d05 00002000:00100000:1.0:1788687659.119824:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f/ffff9af3c3150000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788687659.119838:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788687659.120047:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788687659.121568:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9af3c3155000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687659.121633:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2345:x1875574819654400:12345-192.168.204.26@tcp:8: Request processed in 1842us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687659.121644:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:0.0:1788687659.121868:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819654656 00000100:00100000:0.0:1788687659.121886:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819654656 00000100:00100000:0.0:1788687659.121942:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:0.0:1788687659.121951:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819654656:12345-192.168.204.26@tcp:400: 00000100:00100000:0.0:1788687659.122002:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819654656:12345-192.168.204.26@tcp:400: Request processed in 52us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687659.122009:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:3.0:1788687659.125167:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819654528 00000100:00100000:3.0:1788687659.125181:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819654528 00000100:00100000:3.0:1788687659.125308:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:3.0:1788687659.125319:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:5572:x1875574819654528:12345-192.168.204.26@tcp:33: 00000004:00080000:2.0:1788687659.145581:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20194us 00000004:00200000:3.0:1788687659.160575:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788687659.162636:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:5572:x1875574819654528:12345-192.168.204.26@tcp:33: Request processed in 37308us (43875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687659.162660:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:1.0:1788687659.419020:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687659.419176:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819654784 00000100:00100000:0.0:1788687659.419186:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819654784 00000100:00100000:0.0:1788687659.419244:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:0.0:1788687659.419253:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:5613:x1875574819654784:12345-192.168.204.26@tcp:101: 00010000:00010000:0.0:1788687659.419273:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687659.419348:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c0030c00/0xc2ddd83e74448d0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462a7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687659.419414:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c0031000/0xc2ddd83e74448d13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687659.419427:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c0031000/0xc2ddd83e74448d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687659.419441:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c0031000/0xc2ddd83e74448d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687659.419475:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788687659.419526:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687659.419555:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c0031000/0xc2ddd83e74448d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687659.419580:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c0030c00/0xc2ddd83e74448d0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a7f expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687659.419620:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c0031000/0xc2ddd83e74448d13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a7f expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687659.419629:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736400) 00010000:00010000:0.0:1788687659.419632:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687659.419635:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c0031000, rc 0) 00000100:00100000:0.0:1788687659.419690:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:5613:x1875574819654784:12345-192.168.204.26@tcp:101: Request processed in 438us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687659.419697:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00010000:00010000:0.0:1788687659.528139:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687660.102305:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839597568:0@lo:13: 00000100:00100000:2.0:1788687660.102694:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687660.102805:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839597568 00000100:00100000:2.0:1788687660.102815:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839597568 00000100:00080000:3.0:1788687660.102855:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687660.102879:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788687660.102889:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839597568:12345-0@lo:13: 00000100:00100000:3.0:1788687660.102892:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788687660.102903:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1788687660.102918:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687660.104548:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839597568:12345-0@lo:13: Request processed in 1645us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687660.104561:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788687660.104882:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c5b66a00 x1875574839597568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687660.104909:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839597568:0@lo:13: 00000100:00100000:1.0:1788687660.108403:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839597952:0@lo:400: 00000100:00100000:1.0:1788687660.108542:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687660.108587:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687660.108594:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839597824:0@lo:400: 00000100:00100000:1.0:1788687660.108623:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687660.108688:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839597696:0@lo:400: 00000100:00100000:1.0:1788687660.108724:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687660.108755:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839598208:0@lo:400: 00000100:00100000:1.0:1788687660.108786:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687660.108803:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788687660.108808:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839598080:0@lo:400: 00000100:00100000:1.0:1788687660.108831:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687660.108862:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839597696 00000100:00100000:1.0:1788687660.108869:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839597696 00000100:00100000:1.0:1788687660.108921:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788687660.108930:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839597696:12345-0@lo:400: 00000100:00100000:1.0:1788687660.108978:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839597696:12345-0@lo:400: Request processed in 49us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687660.108984:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788687660.109011:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839597952 00000100:00100000:1.0:1788687660.109014:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839597952 00000100:00100000:1.0:1788687660.109038:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839597824 00000100:00100000:1.0:1788687660.109040:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839597824 00000100:00100000:1.0:1788687660.109050:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839598080 00000100:00100000:1.0:1788687660.109052:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839598080 00000100:00100000:1.0:1788687660.109064:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788687660.109069:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839597952:12345-0@lo:400: 00000100:00100000:1.0:1788687660.109098:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839597952:12345-0@lo:400: Request processed in 29us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687660.109104:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788687660.109113:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788687660.109118:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839597824:12345-0@lo:400: 00000100:00100000:1.0:1788687660.109137:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839597824:12345-0@lo:400: Request processed in 20us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687660.109143:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788687660.109153:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788687660.109158:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839598080:12345-0@lo:400: 00000100:00100000:1.0:1788687660.109176:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839598080:12345-0@lo:400: Request processed in 18us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687660.109182:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788687660.109214:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839597824:0@lo:400: 00000100:00100000:1.0:1788687660.109231:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839597952:0@lo:400: 00000100:00100000:1.0:1788687660.109256:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839598080:0@lo:400: 00000100:00100000:1.0:1788687660.109263:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839597696:0@lo:400: 00000100:00100000:2.0:1788687660.110146:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839598208 00000100:00100000:2.0:1788687660.110155:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839598208 00000100:00100000:2.0:1788687660.110199:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788687660.110208:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839598208:12345-0@lo:400: 00000100:00100000:2.0:1788687660.110270:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839598208:12345-0@lo:400: Request processed in 63us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687660.110288:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788687660.110685:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c5b66d80 x1875574839598208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687660.110698:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788687660.110714:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839598208:0@lo:400: 00000100:00080000:3.0:1788687660.111090:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788687660.111104:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1788687660.177051:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00010000:00010000:1.0:1788687660.550731:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687660.614925:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687660.614966:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839598336:0@lo:13: 00000100:00100000:1.0:1788687660.615053:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687660.615379:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839598336 00000100:00100000:2.0:1788687660.615388:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839598336 00000100:00100000:2.0:1788687660.615447:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788687660.615457:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839598336:12345-0@lo:13: 00002000:00000024:2.0:1788687660.615711:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687660.615870:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839598336:12345-0@lo:13: Request processed in 412us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687660.615878:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788687660.615966:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f40bb800 x1875574839598336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687660.615986:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839598336:0@lo:13: 00010000:00010000:0.0:1788687661.576140:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687661.756179:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687661.756270:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819654912 00000100:00100000:3.0:1788687661.756282:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819654912 00000100:00100000:3.0:1788687661.756371:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:3.0:1788687661.756383:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:5665:x1875574819654912:12345-192.168.204.26@tcp:41: 00000004:00000024:3.0:1788687661.756428:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788687661.756552:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:5665:x1875574819654912:12345-192.168.204.26@tcp:41: Request processed in 171us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687661.756560:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00080000:0.0:1788687661.757168:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687661.763281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687661.763379:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819655040 00000100:00100000:3.0:1788687661.763388:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819655040 00000100:00100000:3.0:1788687661.763472:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:3.0:1788687661.763521:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:5665:x1875574819655040:12345-192.168.204.26@tcp:13: 00002000:00000024:3.0:1788687661.763560:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687661.763671:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:5665:x1875574819655040:12345-192.168.204.26@tcp:13: Request processed in 189us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687661.763679:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00080000:0.0:1788687661.763802:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687661.778812:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687661.778940:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819655168 00000100:00100000:0.0:1788687661.778953:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819655168 00000100:00100000:0.0:1788687661.779036:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:0.0:1788687661.779050:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:5665:x1875574819655168:12345-192.168.204.26@tcp:13: 00002000:00000024:0.0:1788687661.779079:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687661.779151:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:5665:x1875574819655168:12345-192.168.204.26@tcp:13: Request processed in 106us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687661.779159:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00080000:3.0:1788687661.779636:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788687662.271039:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00010000:00010000:1.0:1788687662.598231:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788687663.265423:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00010000:00010000:0.0:1788687663.628047:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687664.619735:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687664.619789:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687664.619842:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687664.619888:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687664.619930:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819655552 00000100:00100000:3.0:1788687664.620223:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819655680 00000100:00100000:3.0:1788687664.620229:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819655680 00000100:00100000:3.0:1788687664.620313:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788687664.620325:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819655680:12345-192.168.204.26@tcp:400: 00000100:00100000:3.0:1788687664.620418:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819655680:12345-192.168.204.26@tcp:400: Request processed in 96us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687664.620426:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00080000:3.0:1788687664.620521:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788687664.620893:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819655424 00000100:00100000:0.0:1788687664.620899:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819655424 00000100:00100000:0.0:1788687664.620963:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:0.0:1788687664.620972:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819655424:12345-192.168.204.26@tcp:400: 00000100:00100000:0.0:1788687664.621026:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819655424:12345-192.168.204.26@tcp:400: Request processed in 56us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687664.621033:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:2.0:1788687664.621260:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819655552 00000100:00100000:1.0:1788687664.621363:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819655296 00000100:00100000:1.0:1788687664.621368:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819655296 00000100:00100000:1.0:1788687664.621411:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:1.0:1788687664.621420:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2349:x1875574819655296:12345-192.168.204.26@tcp:400: 00000100:00100000:1.0:1788687664.621469:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2349:x1875574819655296:12345-192.168.204.26@tcp:400: Request processed in 51us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687664.621477:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00080000:3.0:1788687664.622049:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687664.622165:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:0.0:1788687664.622175:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819655552:12345-192.168.204.26@tcp:400: 00000100:00100000:0.0:1788687664.622221:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819655552:12345-192.168.204.26@tcp:400: Request processed in 50us (2432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687664.622228:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00080000:3.0:1788687664.622532:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788687664.648049:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788687664.831228:0:8297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788687665.222396:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839598464:0@lo:400: 00000100:00100000:1.0:1788687665.222549:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687665.222809:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839598976:0@lo:400: 00000100:00100000:1.0:1788687665.222843:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687665.222893:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687665.222900:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839598848:0@lo:400: 00000100:00100000:1.0:1788687665.222928:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687665.223168:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839598976 00000100:00100000:1.0:1788687665.223177:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839598976 00000100:00100000:1.0:1788687665.223253:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788687665.223264:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839598976:12345-0@lo:400: 00000100:00100000:1.0:1788687665.223330:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839598976:12345-0@lo:400: Request processed in 69us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687665.223338:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788687665.223365:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839598848 00000100:00100000:1.0:1788687665.223369:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839598848 00000100:00100000:1.0:1788687665.223397:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788687665.223403:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839598848:12345-0@lo:400: 00000100:00100000:1.0:1788687665.223448:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839598848:12345-0@lo:400: Request processed in 45us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687665.223587:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839598464 00000100:00100000:0.0:1788687665.223593:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839598464 00000100:00100000:0.0:1788687665.223632:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788687665.223640:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3311:x1875574839598464:12345-0@lo:400: 00000100:00100000:0.0:1788687665.223684:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3311:x1875574839598464:12345-0@lo:400: Request processed in 46us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687665.223690:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788687665.223755:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788687665.223761:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788687665.223798:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb829500 x1875574839598848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687665.223816:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839598848:0@lo:400: 00000100:00100000:0.0:1788687665.223828:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839598464:0@lo:400: 00000100:00100000:0.0:1788687665.223840:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839598976:0@lo:400: 00000100:00100000:2.0:1788687665.224039:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839598592:0@lo:400: 00000100:00100000:2.0:1788687665.224084:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687665.224117:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839599104:0@lo:400: 00000100:00100000:2.0:1788687665.224141:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687665.224165:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788687665.224171:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839598720:0@lo:400: 00000100:00100000:2.0:1788687665.224194:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687665.224213:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839599232:0@lo:13: 00000100:00100000:2.0:1788687665.224247:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687665.224335:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839599232 00000100:00100000:2.0:1788687665.224340:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839599232 00000100:00100000:0.0:1788687665.224358:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839598592 00000100:00100000:0.0:1788687665.224362:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839598592 00000100:00100000:2.0:1788687665.224374:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788687665.224382:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839599232:12345-0@lo:13: 00000100:00100000:0.0:1788687665.224391:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839598720 00000100:00100000:0.0:1788687665.224394:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839598720 00000100:00100000:0.0:1788687665.224414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00002000:00000024:2.0:1788687665.224417:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687665.224419:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839598592:12345-0@lo:400: 00000100:00100000:2.0:1788687665.224469:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839599232:12345-0@lo:13: Request processed in 88us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687665.224471:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839598592:12345-0@lo:400: Request processed in 53us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687665.224476:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788687665.224478:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788687665.224510:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788687665.224516:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839598720:12345-0@lo:400: 00010000:00080000:2.0:1788687665.224530:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f3417100 x1875574839599232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687665.224544:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839598720:12345-0@lo:400: Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687665.224545:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839599232:0@lo:13: 00000100:00100000:0.0:1788687665.224550:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788687665.224556:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839598592:0@lo:400: 00000100:00100000:2.0:1788687665.224579:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839598720:0@lo:400: 00000100:00080000:0.0:1788687665.224584:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687665.224812:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788687665.224823:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788687665.224982:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839599104 00000100:00100000:0.0:1788687665.224986:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839599104 00000100:00080000:3.0:1788687665.225414:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788687665.228383:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788687665.229155:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788687665.229182:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839599104:12345-0@lo:400: 00000100:00100000:0.0:1788687665.229320:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839599104:12345-0@lo:400: Request processed in 153us (5177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687665.229329:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788687665.232201:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb828700 x1875574839599104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687665.232226:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839599104:0@lo:400: 00010000:00010000:2.0:1788687665.671246:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687665.737365:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788687665.737400:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839599360:0@lo:13: 00000100:00100000:0.0:1788687665.737546:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687665.739105:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839599360 00000100:00100000:3.0:1788687665.739123:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839599360 00000100:00100000:3.0:1788687665.739215:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788687665.739229:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839599360:12345-0@lo:13: 00002000:00000024:3.0:1788687665.739284:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687665.739528:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839599360:12345-0@lo:13: Request processed in 257us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687665.739538:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788687665.743198:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb821180 x1875574839599360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687665.743247:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839599360:0@lo:13: 00010000:00010000:1.0:1788687666.695477:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687667.717660:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687668.742306:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788687669.013707:0:8446:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc968581b0 20000000:00000080:2.0:1788687669.013737:0:8446:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af3fc35b400 uarg=0000000000000000 20000000:01000000:2.0:1788687669.014028:0:8446:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788687669.014032:0:8446:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788687669.014035:0:8446:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788687669.014041:0:8446:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788687669.014047:0:8446:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788687669.014064:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788687669.014067:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788687669.014299:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788687669.014303:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788687669.017336:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788687669.019642:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788687669.019707:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788687669.019775:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788687669.019794:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788687669.019797:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788687669.023325:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788687669.023995:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788687669.024082:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788687669.024134:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788687669.024151:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788687669.024155:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788687669.027298:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788687669.029254:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788687669.029351:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788687669.029404:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788687669.029423:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788687669.029426:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788687669.031253:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788687669.032163:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788687669.032223:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788687669.032260:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1788687669.032285:0:8446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788687669.032312:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032338:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c13ec600/0xc2ddd83e74448c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c10 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032346:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74448c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c3a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032353:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aad600/0xc2ddd83e74448c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c64 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032370:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c72 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032378:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448c87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c80 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032384:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448ca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c9c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032391:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448cc6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032403:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74448cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a1d expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032428:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74448ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a24 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032437:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032612:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74448ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a24 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032633:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74448ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a24 expref: 9 pid: 5834 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.032652:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839599488:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687669.032871:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74448cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a1d expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032880:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74448cdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a1d expref: 9 pid: 5834 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.032889:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839599616:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687669.032922:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448cc6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.032930:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448ccd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448cc6 expref: 18 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.032940:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839599744:0@lo:104: 00000100:00100000:0.0:1788687669.032992:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788687669.033059:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448c9c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.033068:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448ca3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448c9c expref: 18 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.033077:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839599872:0@lo:104: 00000100:00100000:0.0:1788687669.033102:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788687669.033136:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448c80 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.033145:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448c80 expref: 18 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.033152:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839600000:0@lo:104: 00010000:00010000:0.0:1788687669.033176:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448c72 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.033184:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448c72 expref: 18 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.033192:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839600128:0@lo:104: 00010000:00010000:0.0:1788687669.033215:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aad600/0xc2ddd83e74448c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448c64 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.033223:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3e0aad600/0xc2ddd83e74448c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448c64 expref: 18 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.033231:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839600256:0@lo:104: 00010000:00010000:0.0:1788687669.033254:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74448c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448c3a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.033269:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74448c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448c3a expref: 18 pid: 5834 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.033278:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839600384:0@lo:104: 00010000:00010000:0.0:1788687669.033305:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c13ec600/0xc2ddd83e74448c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448c10 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.033313:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c13ec600/0xc2ddd83e74448c17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448c10 expref: 18 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.033321:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839600512:0@lo:104: 00000100:00100000:0.0:1788687669.033341:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c57a6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687669.033633:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788687669.033658:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687669.033672:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687669.033689:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687669.033696:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687669.033704:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687669.033721:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839599744 00000100:00100000:1.0:1788687669.033729:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839599744 00000100:00100000:1.0:1788687669.033780:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839599872 00000100:00100000:1.0:1788687669.033784:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839599872 00000100:00100000:1.0:1788687669.033794:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839600000 00000100:00100000:1.0:1788687669.033796:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839600000 00000100:00100000:1.0:1788687669.033804:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839600128 00000100:00100000:1.0:1788687669.033806:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839600128 00000100:00100000:1.0:1788687669.033814:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839600256 00000100:00100000:1.0:1788687669.033817:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839600256 00000100:00100000:1.0:1788687669.033824:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839600384 00000100:00100000:1.0:1788687669.033827:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839600384 00000100:00100000:1.0:1788687669.033836:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839600512 00000100:00100000:1.0:1788687669.033838:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839600512 00000100:00100000:1.0:1788687669.033851:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788687669.034185:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:8446:x1875574839599744:12345-0@lo:104: 00010000:00010000:1.0:1788687669.034277:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.034538:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788687669.034538:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839599744:0@lo:104: 00000100:00100000:1.0:1788687669.034545:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+9:8446:x1875574839599744:12345-0@lo:104: Request processed in 367us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.034553:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788687669.034580:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788687669.034588:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+8:8446:x1875574839599872:12345-0@lo:104: 00010000:00010000:1.0:1788687669.034597:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.034706:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839599872:0@lo:104: 00010000:00010000:1.0:1788687669.035079:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788687669.035086:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+8:8446:x1875574839599872:12345-0@lo:104: Request processed in 499us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.035094:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788687669.035136:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788687669.035144:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+7:8446:x1875574839600000:12345-0@lo:104: 00010000:00010000:1.0:1788687669.035154:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035227:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788687669.035238:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035247:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad200 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687669.035253:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035263:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687669.035270:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687669.035276:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687669.035323:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035338:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687669.035380:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035389:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448cc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035417:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788687669.035421:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035427:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c0030000 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687669.035430:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035436:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687669.035442:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687669.035459:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687669.035472:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035499:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687669.035515:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035522:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c0030000/0xc2ddd83e74448c9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035532:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687669.035534:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035550:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ec800 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687669.035553:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035560:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687669.035566:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687669.035571:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687669.035584:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035590:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687669.035595:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035602:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec800/0xc2ddd83e74448c80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.035611:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687669.035612:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687669.035614:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687669.035643:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839600640:0@lo:103: 00000100:00100000:2.0:1788687669.035686:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687669.035745:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839600896:0@lo:103: 00000100:00100000:2.0:1788687669.035784:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687669.035811:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788687669.035816:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839600768:0@lo:103: 00000100:00100000:2.0:1788687669.035835:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687669.036057:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839600640 00000100:00100000:2.0:1788687669.036066:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839600640 00010000:00010000:2.0:1788687669.036103:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448ccd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448cc6 expref: 19 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687669.036132:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839600896 00000100:00100000:2.0:1788687669.036135:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839600896 00010000:00010000:2.0:1788687669.036144:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448c87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c80 expref: 20 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687669.036154:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839600768 00000100:00100000:2.0:1788687669.036156:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839600768 00010000:00010000:2.0:1788687669.036165:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448ca3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c9c expref: 21 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687669.036176:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788687669.036183:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+21:3311:x1875574839600640:12345-0@lo:103: 00010000:00010000:2.0:1788687669.036196:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687669.036306:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448ccd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448cc6 expref: 21 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.036317:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448cc6 expref: 21 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.036335:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448ccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448cc6 expref: 21 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.036350:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687669.036401:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+20:3311:x1875574839600640:12345-0@lo:103: Request processed in 218us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687669.036408:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788687669.036426:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788687669.036432:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839600896:12345-0@lo:103: 00010000:00010000:2.0:1788687669.036439:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687669.036443:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448c87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c80 expref: 19 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.036452:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448c80 expref: 19 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.036462:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687669.036508:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839600896:12345-0@lo:103: Request processed in 76us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687669.036514:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788687669.036525:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788687669.036531:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:3313:x1875574839600768:12345-0@lo:103: 00010000:00010000:2.0:1788687669.036538:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687669.036542:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448ca3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c9c expref: 18 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.036550:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448c9c expref: 18 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.036560:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448ca3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448c9c expref: 18 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.036570:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687669.036594:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:3313:x1875574839600768:12345-0@lo:103: Request processed in 64us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687669.036600:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788687669.036653:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839600640:0@lo:103: 00010000:00010000:1.0:1788687669.036675:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788687669.036690:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+7:8446:x1875574839600000:12345-0@lo:104: Request processed in 1544us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687669.036691:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839600768:0@lo:103: 00000100:00100000:2.0:1788687669.036704:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839600896:0@lo:103: 00000100:00100000:1.0:1788687669.036708:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788687669.036740:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788687669.036753:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+6:8446:x1875574839600128:12345-0@lo:104: 00010000:00010000:1.0:1788687669.036767:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.036907:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788687669.036915:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+6:8446:x1875574839600128:12345-0@lo:104: Request processed in 167us (3240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.036923:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788687669.036947:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788687669.036958:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:8446:x1875574839600256:12345-0@lo:104: 00010000:00010000:1.0:1788687669.036969:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.037019:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788687669.037026:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:8446:x1875574839600256:12345-0@lo:104: Request processed in 72us (3334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.037033:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788687669.037055:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788687669.037063:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:8446:x1875574839600384:12345-0@lo:104: 00010000:00010000:1.0:1788687669.037073:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.037110:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788687669.037117:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:8446:x1875574839600384:12345-0@lo:104: Request processed in 55us (3418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.037125:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788687669.037144:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788687669.037153:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:8446:x1875574839600512:12345-0@lo:104: 00010000:00010000:1.0:1788687669.037164:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.037202:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788687669.037208:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:8446:x1875574839600512:12345-0@lo:104: Request processed in 57us (3501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.037216:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788687669.037648:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788687669.037656:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.037665:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c0030200 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687669.037669:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.037679:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687669.037687:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687669.037693:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687669.037739:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.037847:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687669.037927:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.037936:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c0030200/0xc2ddd83e74448c72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.037962:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788687669.037965:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.037972:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8600 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687669.037975:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.037982:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687669.037989:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687669.037994:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687669.038017:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038023:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687669.038028:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038035:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af4021d8600/0xc2ddd83e74448c64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038043:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788687669.038046:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038061:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c0031200 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687669.038064:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038071:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687669.038077:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687669.038081:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687669.038102:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038108:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687669.038119:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038126:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c0031200/0xc2ddd83e74448c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c41 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038137:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687669.038140:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038146:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad800 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687669.038149:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038166:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687669.038173:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687669.038178:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687669.038191:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038197:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687669.038202:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038281:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74448c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c17 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687669.038297:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687669.038300:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687669.038302:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687669.038321:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839601024:0@lo:103: 00000100:00100000:1.0:1788687669.038395:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839601280:0@lo:103: 00000100:00100000:2.0:1788687669.038698:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687669.038734:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687669.038774:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839601024 00000100:00100000:1.0:1788687669.038795:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839601024 00010000:00010000:3.0:1788687669.039013:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687669.039625:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687669.039763:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839601408:0@lo:103: 00010000:00010000:1.0:1788687669.039769:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448c79 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c72 expref: 17 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687669.039813:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839601280 00000100:00100000:3.0:1788687669.039940:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687669.039981:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839601152:0@lo:103: 00000100:00100000:1.0:1788687669.039982:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839601280 00010000:00010000:1.0:1788687669.040009:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74448c41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c3a expref: 18 pid: 5834 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687669.040026:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839601408 00000100:00100000:1.0:1788687669.040030:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839601408 00010000:00010000:1.0:1788687669.040043:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c13ec600/0xc2ddd83e74448c17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c10 expref: 19 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687669.040053:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687669.040065:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839601152 00000100:00100000:1.0:1788687669.040070:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839601152 00010000:00010000:1.0:1788687669.040084:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aad600/0xc2ddd83e74448c6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c64 expref: 20 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687669.040100:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788687669.040112:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+20:3310:x1875574839601024:12345-0@lo:103: 00010000:00010000:1.0:1788687669.040129:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687669.040136:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448c79 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c72 expref: 20 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040149:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448c72 expref: 20 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040176:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788687669.040176:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448c87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448c80 expref: 20 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687669.040195:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839600000:0@lo:104: 00010000:00010000:0.0:1788687669.040213:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c0030600/0xc2ddd83e74448c79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448c72 expref: 19 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687669.040222:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:3310:x1875574839601024:12345-0@lo:103: Request processed in 112us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687669.040225:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839600128:0@lo:104: 00000100:00100000:1.0:1788687669.040236:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788687669.040243:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839600256:0@lo:104: 00000100:00100000:0.0:1788687669.040260:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839600384:0@lo:104: 00000100:00100000:1.0:1788687669.040269:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788687669.040274:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839600512:0@lo:104: 00000100:00100000:1.0:1788687669.040280:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:3312:x1875574839601280:12345-0@lo:103: 00010000:00010000:1.0:1788687669.040291:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687669.040296:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74448c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c3a expref: 17 pid: 5834 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040305:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74448c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448c3a expref: 17 pid: 5834 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040315:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74448c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448c3a expref: 17 pid: 5834 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040326:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687669.040377:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:3312:x1875574839601280:12345-0@lo:103: Request processed in 100us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.040384:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788687669.040400:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788687669.040407:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:3313:x1875574839601408:12345-0@lo:103: 00010000:00010000:1.0:1788687669.040416:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687669.040421:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c13ec600/0xc2ddd83e74448c17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c10 expref: 15 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040431:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c13ec600/0xc2ddd83e74448c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448c10 expref: 15 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040444:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ec600/0xc2ddd83e74448c17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448c10 expref: 15 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040456:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687669.040463:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839601024:0@lo:103: 00000100:00100000:1.0:1788687669.040561:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:3313:x1875574839601408:12345-0@lo:103: Request processed in 155us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.040575:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788687669.040592:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788687669.040599:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c6908450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:3311:x1875574839601152:12345-0@lo:103: 00010000:00010000:1.0:1788687669.040608:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788687669.040611:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839601408:0@lo:103: 00010000:00010000:1.0:1788687669.040616:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aad600/0xc2ddd83e74448c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c64 expref: 13 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040626:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aad600/0xc2ddd83e74448c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448c64 expref: 13 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040638:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aad600/0xc2ddd83e74448c6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448c64 expref: 13 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.040647:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687669.040683:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c6908450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:3311:x1875574839601152:12345-0@lo:103: Request processed in 85us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.040691:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788687669.040699:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839601280:0@lo:103: 00000100:00100000:3.0:1788687669.040766:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839601152:0@lo:103: 00000100:00100000:1.0:1788687669.041047:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687669.041085:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687669.041118:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819655808 00000100:00100000:1.0:1788687669.041123:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819655808 00010000:00010000:1.0:1788687669.041146:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74448ce2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a24 expref: 10 pid: 5834 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687669.041162:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819655936 00000100:00100000:1.0:1788687669.041164:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819655936 00010000:00010000:1.0:1788687669.041176:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74448cdb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a1d expref: 11 pid: 5834 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687669.041203:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:1.0:1788687669.041210:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:2349:x1875574819655808:12345-192.168.204.26@tcp:103: 00010000:00010000:1.0:1788687669.041219:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687669.041224:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74448ce2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a24 expref: 11 pid: 5834 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041235:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74448ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a24 expref: 11 pid: 5834 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041247:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687669.041299:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:2349:x1875574819655808:12345-192.168.204.26@tcp:103: Request processed in 89us (255us total) trans 0 rc 0/0 00010000:00010000:0.0:1788687669.041303:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74448ce2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a24 expref: 11 pid: 5834 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687669.041311:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:0.0:1788687669.041325:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839599488:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687669.041330:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:0.0:1788687669.041338:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875574839599616:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687669.041342:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:2349:x1875574819655936:12345-192.168.204.26@tcp:103: 00010000:00010000:1.0:1788687669.041352:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687669.041356:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74448cdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a1d expref: 9 pid: 5834 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041375:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74448cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a1d expref: 9 pid: 5834 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041386:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74448cdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a1d expref: 9 pid: 5834 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041398:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041416:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041433:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041441:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041449:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041457:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041465:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c1536e00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687669.041470:0:5825:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041506:0:5825:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041518:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687669.041530:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687669.041552:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:2349:x1875574819655936:12345-192.168.204.26@tcp:103: Request processed in 214us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.041558:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00010000:00010000:0.0:1788687669.041685:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.041697:0:8446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.041704:0:8446:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687669.041710:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c1536e00/0xc2ddd83e74448d1a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687669.746821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687669.749669:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687669.749712:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687669.749756:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687669.749819:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819656320 00000100:00100000:2.0:1788687669.749824:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819656448 00000100:00100000:0.0:1788687669.749841:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819656320 00000100:00100000:2.0:1788687669.749855:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819656448 00000100:00100000:0.0:1788687669.749953:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:0.0:1788687669.749967:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819656320:12345-192.168.204.26@tcp:400: 00000100:00100000:2.0:1788687669.750057:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:2.0:1788687669.750072:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819656448:12345-192.168.204.26@tcp:400: 00000100:00100000:0.0:1788687669.750087:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819656320:12345-192.168.204.26@tcp:400: Request processed in 120us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687669.750098:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788687669.750148:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819656448:12345-192.168.204.26@tcp:400: Request processed in 78us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687669.750158:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:3.0:1788687669.750302:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819656192 00000100:00100000:3.0:1788687669.750308:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819656192 00000100:00100000:3.0:1788687669.750374:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:0.0:1788687669.750384:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788687669.750385:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819656192:12345-192.168.204.26@tcp:400: 00000100:00100000:0.0:1788687669.750399:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788687669.750471:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819656192:12345-192.168.204.26@tcp:400: Request processed in 89us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687669.750510:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00080000:3.0:1788687669.750530:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788687669.750535:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788687669.750537:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788687669.751012:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819656064 00000100:00100000:1.0:1788687669.751025:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819656064 00000100:00100000:1.0:1788687669.751062:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:1.0:1788687669.751072:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:2349:x1875574819656064:12345-192.168.204.26@tcp:400: 00000100:00100000:1.0:1788687669.751118:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:2349:x1875574819656064:12345-192.168.204.26@tcp:400: Request processed in 48us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687669.751124:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 130 00010000:00010000:2.0:1788687669.768031:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687670.342300:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839601792:0@lo:400: 00000100:00100000:0.0:1788687670.342419:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.342561:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788687670.342568:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839601920:0@lo:400: 00000100:00100000:0.0:1788687670.342599:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.342646:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839601920 00000100:00100000:0.0:1788687670.342657:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839601920 00000100:00100000:3.0:1788687670.342771:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839601664:0@lo:400: 00000100:00100000:3.0:1788687670.342807:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.342910:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839602176:0@lo:400: 00000100:00100000:3.0:1788687670.342936:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.342965:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788687670.342972:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839601536:0@lo:400: 00000100:00100000:3.0:1788687670.343006:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.343033:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839602048:0@lo:400: 00000100:00100000:3.0:1788687670.343057:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.343094:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839601792 00000100:00100000:3.0:1788687670.343098:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839601792 00000100:00100000:3.0:1788687670.343163:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839601664 00000100:00100000:3.0:1788687670.343168:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839601664 00000100:00100000:3.0:1788687670.343182:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839602048 00000100:00100000:3.0:1788687670.343185:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839602048 00000100:00100000:3.0:1788687670.343204:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788687670.343212:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839601792:12345-0@lo:400: 00000100:00100000:3.0:1788687670.343276:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839601792:12345-0@lo:400: Request processed in 64us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.343299:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788687670.343318:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788687670.343324:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839601664:12345-0@lo:400: 00000100:00100000:3.0:1788687670.343370:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839601664:12345-0@lo:400: Request processed in 46us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.343375:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788687670.343386:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788687670.343392:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839602048:12345-0@lo:400: 00000100:00100000:3.0:1788687670.343417:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839602048:12345-0@lo:400: Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.343422:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788687670.343442:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839601536 00000100:00100000:3.0:1788687670.343446:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839601536 00000100:00100000:3.0:1788687670.343473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788687670.343507:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:3311:x1875574839601536:12345-0@lo:400: 00000100:00100000:3.0:1788687670.343539:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:3311:x1875574839601536:12345-0@lo:400: Request processed in 60us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.343545:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1788687670.343574:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687670.343610:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839601536:0@lo:400: 00000100:00100000:3.0:1788687670.343627:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839602048:0@lo:400: 00000100:00100000:3.0:1788687670.343637:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839601664:0@lo:400: 00000100:00100000:0.0:1788687670.343980:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839602176 00000100:00100000:0.0:1788687670.343985:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839602176 00000100:00100000:0.0:1788687670.344009:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788687670.344017:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839601920:12345-0@lo:400: 00000100:00100000:0.0:1788687670.344064:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839601920:12345-0@lo:400: Request processed in 48us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.344070:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788687670.344085:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788687670.344092:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839602176:12345-0@lo:400: 00000100:00100000:0.0:1788687670.344137:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839602176:12345-0@lo:400: Request processed in 46us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.344143:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788687670.344165:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788687670.344169:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788687670.344201:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c5b66d80 x1875574839601920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687670.344215:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839601920:0@lo:400: 00000100:00100000:2.0:1788687670.344614:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788687670.344629:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839602304:0@lo:13: 00000100:00100000:2.0:1788687670.344687:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.345330:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839601792:0@lo:400: 00000100:00100000:0.0:1788687670.345422:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839602304 00000100:00100000:0.0:1788687670.345429:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839602304 00000100:00100000:0.0:1788687670.345478:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788687670.345510:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839602304:12345-0@lo:13: 00002000:00000024:0.0:1788687670.345572:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687670.345637:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839602304:12345-0@lo:13: Request processed in 128us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.345644:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788687670.345722:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb823480 x1875574839602304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687670.345742:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839602304:0@lo:13: 00010000:00080000:0.0:1788687670.345804:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c5b65500 x1875574839602176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687670.345815:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839602176:0@lo:400: 10000000:01000000:1.0:1788687670.661638:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788687670.661651:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3ffb81000 from 39 10000000:01000000:1.0:1788687670.661659:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788687670.661729:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687670.661743:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687670.661756:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687670.661787:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839602432:0@lo:101: 00000100:00100000:1.0:1788687670.661885:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687670.662058:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.662177:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839602432 00000100:00100000:0.0:1788687670.662188:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839602432 00000100:00100000:0.0:1788687670.662713:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788687670.662727:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+12:5836:x1875574839602432:12345-0@lo:101: 00010000:00010000:0.0:1788687670.662745:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687670.662766:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c1537600/0xc2ddd83e74448d28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448d21 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.662797:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c1537600/0xc2ddd83e74448d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448d21 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.662809:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c1537600/0xc2ddd83e74448d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448d21 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.662820:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c1537600, rc 0) 00000100:00100000:0.0:1788687670.662888:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839602432:12345-0@lo:101: Request processed in 165us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.662917:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788687670.663089:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839602432:0@lo:101: 00010000:00010000:1.0:1788687670.663110:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687670.663121:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687670.663208:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839602560:0@lo:501: 00000100:00100000:1.0:1788687670.663251:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687670.663442:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.663625:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839602560 00000100:00100000:0.0:1788687670.663632:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839602560 00000100:00100000:0.0:1788687670.663659:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788687670.663667:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839602560:12345-0@lo:501: 00000100:00100000:0.0:1788687670.664010:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839602560:12345-0@lo:501: Request processed in 343us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.664018:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788687670.665359:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839602560:0@lo:501: 00000100:00100000:1.0:1788687670.665537:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839602688:0@lo:503: 00000100:00100000:1.0:1788687670.665622:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687670.665673:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.665917:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839602688 00000100:00100000:0.0:1788687670.665925:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839602688 00000100:00100000:0.0:1788687670.666261:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788687670.666273:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839602688:12345-0@lo:503: 00000100:00100000:0.0:1788687670.666933:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839602688:12345-0@lo:503: Request processed in 660us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.666942:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788687670.667089:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839602688:0@lo:503: 00000100:00100000:0.0:1788687670.667761:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8464:1875574839602816:0@lo:502: 00000100:00100000:0.0:1788687670.667824:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.668040:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788687670.668109:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839602816 00000100:00100000:2.0:1788687670.668117:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839602816 00000100:00100000:2.0:1788687670.668210:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788687670.668222:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:8464:x1875574839602816:12345-0@lo:502: 00000100:00100000:2.0:1788687670.668542:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:8464:x1875574839602816:12345-0@lo:502: Request processed in 322us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687670.668550:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788687670.668642:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8464:1875574839602816:0@lo:502: 00000100:00100000:0.0:1788687670.668693:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8464:1875574839602944:0@lo:502: 00000100:00100000:0.0:1788687670.668732:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.669016:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687670.669155:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839602944 00000100:00100000:3.0:1788687670.669161:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839602944 00000100:00100000:3.0:1788687670.669191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788687670.669207:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:8464:x1875574839602944:12345-0@lo:502: 00000100:00100000:3.0:1788687670.669398:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:8464:x1875574839602944:12345-0@lo:502: Request processed in 192us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.669452:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788687670.669607:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8464:1875574839602944:0@lo:502: 00000040:00080000:0.0:1788687670.669633:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788687670.669822:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788687670.669906:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788687670.669917:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.669929:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687670.669940:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788687670.669943:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788687670.669946:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788687670.669997:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.670005:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.670014:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687670.670030:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603072:0@lo:101: 00000100:00100000:2.0:1788687670.670066:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687670.670098:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687670.670392:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839603072 00000100:00100000:3.0:1788687670.670398:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839603072 00000100:00100000:3.0:1788687670.670646:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788687670.670654:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+13:5836:x1875574839603072:12345-0@lo:101: 00010000:00010000:3.0:1788687670.670666:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687670.670683:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448d36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448d2f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.670711:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448d2f expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.670722:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448d2f expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.670733:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac200, rc 0) 00000100:00100000:3.0:1788687670.670778:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839603072:12345-0@lo:101: Request processed in 124us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.670784:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788687670.670940:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603072:0@lo:101: 00010000:00010000:3.0:1788687670.670970:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.670980:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687670.671060:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603200:0@lo:501: 00000100:00100000:3.0:1788687670.671091:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.671249:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c831b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687670.671356:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839603200 00000100:00100000:1.0:1788687670.671362:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839603200 00000100:00100000:0.0:1788687670.671411:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788687670.671429:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839603200:12345-0@lo:501: 00000100:00100000:0.0:1788687670.671762:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839603200:12345-0@lo:501: Request processed in 336us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.671769:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788687670.671854:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603200:0@lo:501: 00000100:00100000:3.0:1788687670.671888:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603328:0@lo:503: 00000100:00100000:3.0:1788687670.671931:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.671969:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c831b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.672163:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839603328 00000100:00100000:0.0:1788687670.672168:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839603328 00000100:00100000:0.0:1788687670.672207:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788687670.672214:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839603328:12345-0@lo:503: 00000100:00100000:0.0:1788687670.672406:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839603328:12345-0@lo:503: Request processed in 192us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.672413:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788687670.672530:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603328:0@lo:503: 00000100:00100000:2.0:1788687670.672933:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8465:1875574839603456:0@lo:502: 00000100:00100000:2.0:1788687670.673127:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687670.673167:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.673217:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839603456 00000100:00100000:0.0:1788687670.673224:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839603456 00000100:00100000:0.0:1788687670.673248:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788687670.673255:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:8465:x1875574839603456:12345-0@lo:502: 00000100:00100000:0.0:1788687670.673433:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:8465:x1875574839603456:12345-0@lo:502: Request processed in 177us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.673440:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788687670.673608:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8465:1875574839603456:0@lo:502: 00000020:01000000:2.0:1788687670.673637:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788687670.673648:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687670.673651:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788687670.673658:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788687670.673684:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8465:1875574839603584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687670.673723:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687670.676512:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788687670.676888:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839603584 00000100:00100000:1.0:1788687670.676901:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839603584 00000100:00100000:1.0:1788687670.676972:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788687670.676985:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:8465:x1875574839603584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687670.677531:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8465:1875574839603584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788687670.677582:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788687670.677591:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687670.677594:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788687670.677609:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000100:00100000:1.0:1788687670.677664:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:8465:x1875574839603584:12345-0@lo:502:llog_process_th.0 Request processed in 679us (3937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687670.677674:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000020:01000000:3.0:1788687670.677860:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788687670.677886:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788687670.677900:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.677913:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687670.677926:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788687670.677929:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3f39f5000 from 39 10000000:01000000:3.0:1788687670.677933:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788687670.677988:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.677998:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.678009:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687670.678035:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788687670.678097:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.678140:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c831b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788687670.678311:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839603712 00000100:00100000:2.0:1788687670.678318:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839603712 00000100:00100000:2.0:1788687670.678374:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788687670.678383:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:5836:x1875574839603712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687670.678395:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687670.678412:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d8800/0xc2ddd83e74448d44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448d3d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.678441:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d8800/0xc2ddd83e74448d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448d3d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.678452:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d8800/0xc2ddd83e74448d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448d3d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.678462:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d8800, rc 0) 00000100:00100000:2.0:1788687670.678532:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839603712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687670.678538:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788687670.678614:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788687670.678631:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.678642:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687670.678696:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687670.678721:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.678750:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c831b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788687670.678791:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839603840 00000100:00100000:2.0:1788687670.678795:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839603840 00000100:00100000:2.0:1788687670.678811:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788687670.678816:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839603840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687670.679123:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839603840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687670.679129:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788687670.679315:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687670.679369:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687670.679424:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.679445:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c831b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788687670.679608:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839603968 00000100:00100000:2.0:1788687670.679614:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839603968 00000100:00100000:2.0:1788687670.679640:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788687670.679656:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839603968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788687670.679908:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839603968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687670.679915:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788687670.680052:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839603968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687670.680752:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8466:1875574839604096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687670.680812:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.680928:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c831b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788687670.681221:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839604096 00000100:00100000:2.0:1788687670.681229:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839604096 00000100:00100000:2.0:1788687670.681281:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788687670.681290:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:8466:x1875574839604096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687670.681619:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:8466:x1875574839604096:12345-0@lo:502:llog_process_th.0 Request processed in 328us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687670.681627:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788687670.682338:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8466:1875574839604096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687670.682426:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8466:1875574839604224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687670.682518:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.682564:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c831b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.682787:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839604224 00000100:00100000:0.0:1788687670.682794:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839604224 00000100:00100000:1.0:1788687670.683069:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788687670.683083:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:8466:x1875574839604224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687670.683390:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:8466:x1875574839604224:12345-0@lo:502:llog_process_th.0 Request processed in 309us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687670.683398:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788687670.683612:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8466:1875574839604224:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788687670.683659:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788687670.689695:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788687670.689747:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788687670.689764:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.689778:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687670.689792:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788687670.689795:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788687670.689798:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788687670.689864:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.689872:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.689886:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687670.689936:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839604352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788687670.690219:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687670.690288:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.690394:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839604352 00000100:00100000:0.0:1788687670.690407:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839604352 00000100:00100000:0.0:1788687670.690529:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788687670.690542:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:5836:x1875574839604352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788687670.690560:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687670.690577:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c1536a00/0xc2ddd83e74448d52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.690622:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c1536a00/0xc2ddd83e74448d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448d4b expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.690635:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c1536a00/0xc2ddd83e74448d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448d4b expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.690647:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c1536a00, rc 0) 00000100:00100000:0.0:1788687670.690700:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839604352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.690707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788687670.690972:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839604352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687670.690993:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.691004:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687670.691085:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839604480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687670.691117:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687670.691153:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.691302:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839604480 00000100:00100000:0.0:1788687670.691308:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839604480 00000100:00100000:0.0:1788687670.691357:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788687670.691366:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839604480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.691763:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839604480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.691771:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788687670.691871:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839604480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687670.691909:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839604608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687670.691978:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687670.692020:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.696849:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839604608 00000100:00100000:0.0:1788687670.696870:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839604608 00000100:00100000:0.0:1788687670.696952:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788687670.696962:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839604608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.697311:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839604608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 349us (5331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.697320:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788687670.697538:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839604608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.701813:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8467:1875574839604736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788687670.701950:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.702004:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788687670.702139:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839604736 00000100:00100000:1.0:1788687670.702149:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839604736 00000100:00100000:1.0:1788687670.702212:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788687670.702224:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:8467:x1875574839604736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687670.702754:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:8467:x1875574839604736:12345-0@lo:502:llog_process_th.0 Request processed in 530us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687670.702764:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788687670.702983:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8467:1875574839604736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788687670.703029:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788687670.703041:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687670.703044:0:8467:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788687670.703053:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788687670.703087:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8467:1875574839604864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687670.703151:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687670.703180:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.703442:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839604864 00000100:00100000:0.0:1788687670.703449:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839604864 00000100:00100000:0.0:1788687670.703501:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788687670.703511:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:8467:x1875574839604864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788687670.703700:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:8467:x1875574839604864:12345-0@lo:502:llog_process_th.0 Request processed in 190us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.703708:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788687670.703840:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8467:1875574839604864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788687670.703865:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788687670.703871:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687670.703873:0:8467:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788687670.703883:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788687670.704123:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788687670.704150:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788687670.704163:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.704175:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687670.704187:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788687670.704191:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3e6e77800 from 39 10000000:01000000:0.0:1788687670.704194:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788687670.704231:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.704240:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.704249:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687670.704268:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839604992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.704313:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.704360:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788687670.704422:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839604992 00000100:00100000:1.0:1788687670.704429:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839604992 00000100:00100000:1.0:1788687670.704463:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788687670.704472:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839604992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687670.704512:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687670.704530:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448d60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687670.704557:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448d59 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687670.704568:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448d59 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687670.704578:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ecc00, rc 0) 00000100:00100000:1.0:1788687670.704627:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839604992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687670.704634:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788687670.705023:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839604992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788687670.705040:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.705050:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687670.705104:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839605120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.705134:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.705167:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788687670.705220:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839605120 00000100:00100000:3.0:1788687670.705225:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839605120 00000100:00100000:3.0:1788687670.705255:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788687670.705263:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839605120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687670.705752:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839605120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 487us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.705759:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788687670.709090:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839605120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.709190:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839605248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.709303:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.709368:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1780 going to sleep for 11 seconds 00000100:00100000:2.0:1788687670.709708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839605248 00000100:00100000:2.0:1788687670.709718:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839605248 00000100:00100000:2.0:1788687670.709792:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788687670.709804:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839605248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788687670.710061:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839605248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 259us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687670.710070:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788687670.710240:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839605248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687670.712052:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8468:1875574839605376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687670.712150:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687670.712208:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c722f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788687670.712267:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839605376 00000100:00100000:3.0:1788687670.712277:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839605376 00000100:00100000:3.0:1788687670.712342:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788687670.712352:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:8468:x1875574839605376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687670.712680:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:8468:x1875574839605376:12345-0@lo:502:llog_process_th.0 Request processed in 328us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.712689:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788687670.712805:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8468:1875574839605376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687670.712873:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8468:1875574839605504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687670.712910:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687670.712943:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c722f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.713062:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839605504 00000100:00100000:0.0:1788687670.713068:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839605504 00000100:00100000:0.0:1788687670.713108:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788687670.713116:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:8468:x1875574839605504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788687670.713290:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:8468:x1875574839605504:12345-0@lo:502:llog_process_th.0 Request processed in 174us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.713297:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788687670.713558:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8468:1875574839605504:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788687670.713581:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788687670.713899:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788687670.713931:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788687670.713943:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.713954:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687670.713965:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788687670.713969:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788687670.713972:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788687670.714006:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.714015:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.714025:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687670.714041:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839605632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.714080:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.714115:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1900 going to sleep for 11 seconds 00000100:00100000:1.0:1788687670.714967:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839605632 00000100:00100000:1.0:1788687670.714979:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839605632 00000100:00100000:1.0:1788687670.715037:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788687670.715048:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839605632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687670.715065:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687670.715084:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448d6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687670.715114:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448d67 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687670.715127:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448d67 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687670.715138:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ede00, rc 0) 00000100:00100000:1.0:1788687670.715193:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839605632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687670.715199:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788687670.716065:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839605632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788687670.716092:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687670.716105:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687670.716202:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839605760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.716276:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.716322:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788687670.716367:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839605760 00000100:00100000:2.0:1788687670.716375:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839605760 00000100:00100000:2.0:1788687670.716432:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788687670.716441:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839605760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687670.716802:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839605760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687670.716809:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788687670.717624:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839605760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.717688:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839605888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687670.717756:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687670.717803:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788687670.718141:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839605888 00000100:00100000:3.0:1788687670.718149:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839605888 00000100:00100000:3.0:1788687670.718204:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788687670.718215:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839605888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687670.718453:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839605888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.718460:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788687670.718591:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839605888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687670.723542:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8469:1875574839606016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687670.723676:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687670.723747:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c722f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788687670.727088:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839606016 00000100:00100000:2.0:1788687670.727109:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839606016 00000100:00100000:2.0:1788687670.727194:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788687670.727208:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8469:x1875574839606016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687670.727629:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8469:x1875574839606016:12345-0@lo:502:llog_process_th.0 Request processed in 423us (3952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687670.727638:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788687670.727765:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8469:1875574839606016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788687670.727814:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788687670.727838:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687670.727841:0:8469:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788687670.727851:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788687670.727896:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8469:1875574839606144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687670.727962:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687670.728014:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c722f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788687670.728139:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839606144 00000100:00100000:0.0:1788687670.728154:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839606144 00000100:00100000:0.0:1788687670.728196:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788687670.728205:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8469:x1875574839606144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788687670.728392:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8469:x1875574839606144:12345-0@lo:502:llog_process_th.0 Request processed in 188us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687670.728399:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788687670.728603:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8469:1875574839606144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788687670.728627:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788687670.728632:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687670.728634:0:8469:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788687670.728638:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788687670.729373:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788687670.729404:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788687670.729430:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.729455:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687670.729513:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788687670.729517:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af3e0230000 from 1 10000000:01000000:2.0:1788687670.729520:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788687670.729561:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d9e00/0xc2ddd83e74448d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.729570:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af4021d9e00/0xc2ddd83e74448d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.729581:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af4021d9e00/0xc2ddd83e74448d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687670.729604:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839606272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788687670.729663:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687670.729709:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788687670.729776:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839606272 00000100:00100000:3.0:1788687670.729790:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839606272 00000100:00100000:3.0:1788687670.729843:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788687670.729853:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839606272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788687670.729866:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687670.729882:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448d75 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.729910:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448d75 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.729923:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448d75 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.729933:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac400, rc 0) 00000100:00100000:3.0:1788687670.729978:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839606272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.729986:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788687670.730085:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839606272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687670.730103:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af4021d9e00/0xc2ddd83e74448d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.730112:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af4021d9e00/0xc2ddd83e74448d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687670.730182:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839606400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687670.730208:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687670.730244:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788687670.730272:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839606400 00000100:00100000:3.0:1788687670.730276:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839606400 00000100:00100000:3.0:1788687670.730309:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788687670.730315:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839606400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687670.730884:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839606400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 567us (673us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788687670.730892:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788687670.731101:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839606400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788687670.731137:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788687670.731145:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d9e00/0xc2ddd83e74448d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687670.731158:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af4021d9e00/0xc2ddd83e74448d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687670.790173:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687670.854854:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788687670.854896:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839606528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687670.854993:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687670.855144:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839606528 00000100:00100000:3.0:1788687670.855156:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839606528 00000100:00100000:3.0:1788687670.855233:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788687670.855247:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839606528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788687670.855316:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687670.855398:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839606528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687670.855406:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788687670.855930:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb821c00 x1875574839606528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687670.855965:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839606528:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788687671.820634:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687672.810774:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687672.810982:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819656576 00000100:00100000:3.0:1788687672.810993:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819656576 00000100:00100000:3.0:1788687672.811056:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 164 00000100:00100000:3.0:1788687672.811066:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:5586:x1875574819656576:12345-192.168.204.26@tcp:101: 00010000:00010000:3.0:1788687672.811083:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687672.811102:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aac000/0xc2ddd83e74448d83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462a86 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687672.811141:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aac000/0xc2ddd83e74448d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a86 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687672.811153:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aac000/0xc2ddd83e74448d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a86 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687672.811163:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac000, rc 0) 00000100:00100000:3.0:1788687672.811406:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:5586:x1875574819656576:12345-192.168.204.26@tcp:101: Request processed in 341us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687672.811414:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 164 00000100:00100000:2.0:1788687672.816857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687672.817140:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819656704 00000100:00100000:3.0:1788687672.817156:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819656704 00000100:00100000:3.0:1788687672.817234:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 165 00000100:00100000:3.0:1788687672.817247:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:5586:x1875574819656704:12345-192.168.204.26@tcp:501: 00000100:00100000:3.0:1788687672.817728:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:5586:x1875574819656704:12345-192.168.204.26@tcp:501: Request processed in 481us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687672.817748:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 165 00000100:00100000:0.0:1788687672.822462:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687672.822575:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819656832 00000100:00100000:3.0:1788687672.822590:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819656832 00000100:00100000:3.0:1788687672.822665:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 166 00000100:00100000:3.0:1788687672.822677:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:5586:x1875574819656832:12345-192.168.204.26@tcp:503: 00000100:00100000:3.0:1788687672.823016:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:5586:x1875574819656832:12345-192.168.204.26@tcp:503: Request processed in 341us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687672.823025:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 166 00000100:00100000:0.0:1788687672.826699:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687672.826808:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819656960 00000100:00100000:3.0:1788687672.826820:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819656960 00000100:00100000:3.0:1788687672.826895:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:3.0:1788687672.826908:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:6071:x1875574819656960:12345-192.168.204.26@tcp:502: 00000100:00100000:3.0:1788687672.827279:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:6071:x1875574819656960:12345-192.168.204.26@tcp:502: Request processed in 373us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687672.827298:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:0.0:1788687672.832526:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687672.832642:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819657088 00000100:00100000:2.0:1788687672.832657:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819657088 00000100:00100000:2.0:1788687672.832739:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 168 00000100:00100000:2.0:1788687672.832752:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:6071:x1875574819657088:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788687672.833143:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:6071:x1875574819657088:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 393us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687672.833152:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 168 00010000:00010000:3.0:1788687672.837633:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687672.841419:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687672.842364:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819657216 00000100:00100000:2.0:1788687672.842380:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819657216 00000100:00100000:2.0:1788687672.842466:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00100000:2.0:1788687672.842511:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:5586:x1875574819657216:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687672.842537:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687672.842682:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448d8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462a8d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687672.842734:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a8d expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687672.842897:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a8d expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687672.842910:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d8c00, rc 0) 00000100:00100000:2.0:1788687672.843127:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5586:x1875574819657216:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 649us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687672.843135:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00100000:0.0:1788687672.848351:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687672.848469:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819657344 00000100:00100000:3.0:1788687672.848519:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819657344 00000100:00100000:3.0:1788687672.848595:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 170 00000100:00100000:3.0:1788687672.848607:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5586:x1875574819657344:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687672.849015:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5586:x1875574819657344:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 409us (679us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788687672.849025:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 170 00010000:00010000:2.0:1788687673.862277:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788687674.424821:0:8509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee484b300 20000000:00000080:3.0:1788687674.424861:0:8509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af3fb9a8400 uarg=0000000000000000 20000000:01000000:3.0:1788687674.424915:0:8509:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788687674.424923:0:8509:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788687674.424929:0:8509:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788687674.426136:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788687674.426332:0:8509:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788687674.435893:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788687674.435961:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788687674.436027:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788687674.436052:0:8509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788687674.436072:0:8509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687674.436091:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e74448b06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448aff expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687674.436107:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448b61 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687674.436114:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c13ed000/0xc2ddd83e74448c33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448c2c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687674.436123:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c0030400/0xc2ddd83e74448cf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a55 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687674.436131:0:8509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687674.436173:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c0030400/0xc2ddd83e74448cf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a55 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687674.436188:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3c0030400/0xc2ddd83e74448cf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a55 expref: 9 pid: 5831 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687674.436203:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875574839606656:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687674.436329:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c13ed000/0xc2ddd83e74448c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448c2c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687674.436339:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c13ed000/0xc2ddd83e74448c33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448c2c expref: 18 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687674.436349:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875574839606784:0@lo:104: 00000100:00100000:0.0:1788687674.436459:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788687674.436800:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448b61 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687674.436818:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448b61 expref: 18 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687674.436829:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875574839606912:0@lo:104: 00000100:00100000:0.0:1788687674.436857:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788687674.436936:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e74448b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448aff expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687674.436945:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e74448b06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448aff expref: 18 pid: 5831 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687674.436954:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875574839607040:0@lo:104: 00000100:00100000:0.0:1788687674.436974:0:8509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687674.437047:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788687674.437071:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687674.437084:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839606784 00000100:00100000:1.0:1788687674.437090:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839606784 00000100:00100000:1.0:1788687674.437131:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839606912 00000100:00100000:1.0:1788687674.437134:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839606912 00000100:00100000:1.0:1788687674.437144:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839607040 00000100:00100000:1.0:1788687674.437153:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839607040 00000100:00100000:1.0:1788687674.437172:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788687674.437181:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:8509:x1875574839606784:12345-0@lo:104: 00010000:00010000:1.0:1788687674.437195:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687674.437327:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788687674.437333:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:8509:x1875574839606784:12345-0@lo:104: Request processed in 154us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687674.437341:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1788687674.437367:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788687674.437376:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788687674.437382:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687674.437391:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3662050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:8509:x1875574839606912:12345-0@lo:104: 00010000:00010000:1.0:1788687674.437411:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.437416:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c0030a00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:3.0:1788687674.437427:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.437443:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687674.437456:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1788687674.437462:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687674.437464:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3662050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:8509:x1875574839606912:12345-0@lo:104: Request processed in 79us (605us total) trans 0 rc 0/0 10000000:01000000:3.0:1788687674.437513:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788687674.437575:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.437584:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788687674.437612:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.437619:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c0030a00/0xc2ddd83e74448c2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448c33 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.437634:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687674.437637:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.437652:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac800 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:3.0:1788687674.437656:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.437663:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788687674.437670:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687674.437675:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788687674.437690:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.437695:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788687674.437701:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.437708:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac800/0xc2ddd83e74448b61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.437718:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687674.437720:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687674.437722:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687674.437777:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788687674.437817:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788687674.437825:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:8509:x1875574839607040:12345-0@lo:104: 00010000:00010000:1.0:1788687674.437837:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed800/0xc2ddd83e74448aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687674.437937:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875574839606784:0@lo:104: 00000100:00100000:0.0:1788687674.437948:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875574839606912:0@lo:104: 00000100:00100000:0.0:1788687674.437954:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875574839607040:0@lo:104: 00000100:00100000:3.0:1788687674.437993:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839607168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687674.438058:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788687674.438060:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788687674.438069:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:8509:x1875574839607040:12345-0@lo:104: Request processed in 245us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687674.438079:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788687674.438131:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788687674.438141:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839607296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687674.438183:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687674.438234:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839607168 00000100:00100000:3.0:1788687674.438241:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839607168 00000100:00100000:1.0:1788687674.438244:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839607296 00000100:00100000:1.0:1788687674.438253:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839607296 00010000:00010000:3.0:1788687674.438289:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c13ed000/0xc2ddd83e74448c33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c2c expref: 20 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687674.438292:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448b61 expref: 20 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687674.438342:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788687674.438354:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+20:3310:x1875574839607168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687674.438371:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687674.438379:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c13ed000/0xc2ddd83e74448c33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448c2c expref: 20 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687674.438383:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788687674.438399:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+20:3310:x1875574839607296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687674.438405:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c13ed000/0xc2ddd83e74448c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448c2c expref: 20 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687674.438413:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687674.438421:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448b61 expref: 20 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.438430:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ed000/0xc2ddd83e74448c33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448c2c expref: 20 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687674.438437:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448b61 expref: 20 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687674.438460:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448b68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448b61 expref: 19 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687674.438468:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687674.438477:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687674.438576:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:3310:x1875574839607168:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687674.438592:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788687674.438596:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:3310:x1875574839607296:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687674.438607:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788687674.438670:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839607296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687674.438680:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839607168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788687674.439020:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687674.439034:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed800/0xc2ddd83e74448aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.439044:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ed800 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687674.439047:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed800/0xc2ddd83e74448aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.439055:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed800/0xc2ddd83e74448aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687674.439063:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed800/0xc2ddd83e74448aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687674.439069:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788687674.439106:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed800/0xc2ddd83e74448aff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.439113:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687674.439134:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed800/0xc2ddd83e74448aff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.439152:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed800/0xc2ddd83e74448aff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448b06 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.439170:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687674.439172:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687674.439173:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687674.439186:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839607424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788687674.439225:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687674.439696:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839607424 00000100:00100000:2.0:1788687674.439703:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839607424 00010000:00010000:2.0:1788687674.439805:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e74448b06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448aff expref: 17 pid: 5831 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687674.439921:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788687674.439932:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:3312:x1875574839607424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788687674.439945:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687674.439950:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e74448b06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448aff expref: 17 pid: 5831 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.439959:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e74448b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448aff expref: 17 pid: 5831 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.439974:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e74448b06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448aff expref: 17 pid: 5831 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.439987:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687674.440029:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:3312:x1875574839607424:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687674.440049:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788687674.440086:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839607424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687674.440254:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687674.440360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687674.440424:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819657600 00000100:00100000:2.0:1788687674.440429:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819657600 00000100:00100000:2.0:1788687674.440466:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 171 00000100:00100000:2.0:1788687674.440472:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5586:x1875574819657600:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687674.440517:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687674.440535:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462a94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440557:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440567:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 4/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440587:0:5834:0:(ldlm_request.c:384:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440600:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440607:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d9800, rc 0) 00000100:00100000:2.0:1788687674.440655:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:5586:x1875574819657600:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 183us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687674.440661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 171 00000100:00100000:2.0:1788687674.440775:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819657472 00000100:00100000:2.0:1788687674.440787:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819657472 00010000:00010000:2.0:1788687674.440802:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c0030400/0xc2ddd83e74448cf0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a55 expref: 11 pid: 5831 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687674.440841:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:2.0:1788687674.440850:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:2349:x1875574819657472:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687674.440858:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687674.440862:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687674.440864:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c0030400/0xc2ddd83e74448cf0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a55 expref: 11 pid: 5831 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440881:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c0030400/0xc2ddd83e74448cf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a55 expref: 11 pid: 5831 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440897:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440906:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440920:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440927:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440936:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440943:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440948:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c1537400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687674.440958:0:7632:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440967:0:7632:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440979:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.440987:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.441017:0:7632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687674.441031:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:MGS:7632:1875574839607552:192.168.204.26@tcp:105: 00000100:00100000:2.0:1788687674.441099:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8325180 going to sleep for 11 seconds 00010000:00010000:1.0:1788687674.441436:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c0030400/0xc2ddd83e74448cf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a55 expref: 11 pid: 5831 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687674.441451:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875574839606656:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687674.441567:0:8509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687674.441579:0:8509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687674.441598:0:8509:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687674.448606:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:MGS:7632:1875574839607552:192.168.204.26@tcp:105: 00010000:00010000:2.0:1788687674.448636:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.448649:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c1537400/0xc2ddd83e74448d91 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687674.448675:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687674.448743:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2349:x1875574819657472:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 7893us (8490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687674.448753:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:3.0:1788687674.449096:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687674.451605:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819657728 00000100:00100000:2.0:1788687674.451627:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819657728 00000100:00100000:2.0:1788687674.451919:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 172 00000100:00100000:2.0:1788687674.451934:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5586:x1875574819657728:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687674.452901:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5586:x1875574819657728:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 964us (4347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687674.452913:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 172 00000100:00100000:3.0:1788687674.459675:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687674.460220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819657856 00000100:00100000:0.0:1788687674.460237:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819657856 00000100:00100000:0.0:1788687674.460328:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 173 00000100:00100000:0.0:1788687674.460343:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5586:x1875574819657856:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687674.460694:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:5586:x1875574819657856:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 354us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687674.460703:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 173 00000100:00100000:3.0:1788687674.473025:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687674.473139:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819657984 00000100:00100000:0.0:1788687674.473154:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819657984 00000100:00100000:0.0:1788687674.473248:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 174 00000100:00100000:0.0:1788687674.473277:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:6089:x1875574819657984:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788687674.473635:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:6089:x1875574819657984:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 374us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687674.473645:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 174 00000100:00100000:0.0:1788687674.478147:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687674.478201:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819658112 00000100:00100000:0.0:1788687674.478227:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819658112 00000100:00100000:0.0:1788687674.478308:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 175 00000100:00100000:0.0:1788687674.478321:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:6089:x1875574819658112:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788687674.478908:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:6089:x1875574819658112:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 586us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687674.478917:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 175 00000100:00100000:1.0:1788687674.865914:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687674.870872:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819658368 00000100:00100000:3.0:1788687674.870895:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819658368 00000100:00100000:3.0:1788687674.871235:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:3.0:1788687674.871260:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819658368:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687674.871572:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00080000:1.0:1788687674.871637:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687674.871805:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819658240 00000100:00100000:0.0:1788687674.871811:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819658240 00000100:00100000:3.0:1788687674.872285:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819658368:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1036us (6385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687674.872296:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:0.0:1788687674.873021:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 176 00000100:00100000:0.0:1788687674.873037:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819658240:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687674.873542:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819658240:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 508us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687674.873551:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 176 00000100:00100000:3.0:1788687674.874733:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687674.874820:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819658624 00000100:00100000:0.0:1788687674.874830:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819658624 00000100:00100000:3.0:1788687674.874954:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00080000:3.0:1788687674.875147:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687674.875358:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819658496 00000100:00100000:2.0:1788687674.875364:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819658496 00000100:00100000:2.0:1788687674.875454:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:2.0:1788687674.875467:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819658624:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687674.875574:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819658624:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 109us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687674.875582:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:2.0:1788687674.875603:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:2.0:1788687674.875610:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819658496:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687674.875637:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819658496:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 27us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687674.875644:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00080000:3.0:1788687674.876449:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788687674.885646:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788687675.461599:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788687675.461611:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3ffb81000 from 4 10000000:01000000:3.0:1788687675.461618:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788687675.461832:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687675.461921:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687675.461937:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687675.462045:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839607680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788687675.462218:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.462299:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839607680 00000100:00100000:3.0:1788687675.462313:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f159e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788687675.462317:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839607680 00000100:00100000:1.0:1788687675.462394:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788687675.462413:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839607680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687675.462434:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687675.462458:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448da6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448d9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687675.462466:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839607808:0@lo:400:kworker.0 00010000:00010000:1.0:1788687675.462537:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448d9f expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687675.462548:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788687675.462562:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448d9f expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.462575:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ec800, rc 0) 00000100:00100000:3.0:1788687675.462592:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839608320:0@lo:400:kworker.0 00000100:00100000:1.0:1788687675.462769:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839607680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 363us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687675.462776:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788687675.463477:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839607680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687675.463520:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687675.465788:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687675.465853:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788687675.465866:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839608192:0@lo:400:kworker.0 00000100:00100000:3.0:1788687675.465921:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687675.465961:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839607936:0@lo:400:kworker.0 00000100:00100000:3.0:1788687675.465982:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687675.466000:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839608448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687675.466023:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687675.466044:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788687675.466050:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839608064:0@lo:400:kworker.0 00000100:00100000:3.0:1788687675.466070:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687675.466110:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839607808 00000100:00100000:3.0:1788687675.466117:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839607808 00000100:00100000:3.0:1788687675.466158:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839608192 00000100:00100000:3.0:1788687675.466160:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839608192 00000100:00100000:3.0:1788687675.466178:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839607936 00000100:00100000:3.0:1788687675.466180:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839607936 00000100:00100000:3.0:1788687675.466194:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788687675.466201:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839607808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687675.466266:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839607808:12345-0@lo:400:kworker.0 Request processed in 64us (3722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687675.466273:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788687675.466290:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788687675.466296:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839608192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687675.466322:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839608192:12345-0@lo:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687675.466339:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788687675.466351:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788687675.466357:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839607936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687675.466389:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839607936:12345-0@lo:400:kworker.0 Request processed in 32us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687675.466395:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788687675.466415:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839608448 00000100:00100000:3.0:1788687675.466419:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839608448 00000100:00100000:3.0:1788687675.466445:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788687675.466452:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839608448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788687675.466495:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687675.466528:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839608448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687675.466534:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788687675.466554:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788687675.466559:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687675.466593:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839607936:0@lo:400:kworker.0 00010000:00080000:3.0:1788687675.466607:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb820000 x1875574839608448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687675.466626:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839608448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687675.466660:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839608192:0@lo:400:kworker.0 00000100:00100000:3.0:1788687675.466670:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839607808:0@lo:400:kworker.0 00000100:00100000:3.0:1788687675.466706:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839608320 00000100:00100000:3.0:1788687675.466710:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839608320 00000100:00100000:3.0:1788687675.466753:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839608064 00000100:00100000:3.0:1788687675.466757:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839608064 00000100:00100000:3.0:1788687675.466775:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788687675.466781:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839608320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687675.466818:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839608320:12345-0@lo:400:kworker.0 Request processed in 36us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687675.466824:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788687675.466835:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788687675.466841:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839608064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687675.466870:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839608064:12345-0@lo:400:kworker.0 Request processed in 29us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687675.466875:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788687675.466887:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788687675.466904:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f7a5dc00 x1875574839608064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687675.466914:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839608064:0@lo:400:kworker.0 00010000:00080000:3.0:1788687675.466936:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f7a5e300 x1875574839608320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687675.466944:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839608320:0@lo:400:kworker.0 00010000:00010000:1.0:1788687675.467074:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687675.467179:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839608576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.467214:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.467261:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c991e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788687675.470709:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839608576 00000100:00100000:3.0:1788687675.470724:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839608576 00000100:00100000:3.0:1788687675.470799:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788687675.470810:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839608576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687675.471275:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839608576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 467us (4058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687675.471295:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788687675.479611:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839608576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687675.482634:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839608704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687675.482736:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687675.482785:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6eac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687675.482862:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839608704 00000100:00100000:1.0:1788687675.482871:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839608704 00000100:00100000:1.0:1788687675.482937:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788687675.482948:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839608704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.483199:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839608704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687675.483208:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788687675.483411:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839608704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687675.483900:0:8541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8541:1875574839608832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788687675.483943:0:8541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687675.483980:0:8541:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c831ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788687675.484028:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839608832 00000100:00100000:2.0:1788687675.484035:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839608832 00000100:00100000:2.0:1788687675.484076:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788687675.484085:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:8541:x1875574839608832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687675.484283:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:8541:x1875574839608832:12345-0@lo:502:llog_process_th.0 Request processed in 199us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687675.484300:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788687675.484478:0:8541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8541:1875574839608832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788687675.484552:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687675.484564:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687675.484567:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788687675.484573:0:8541:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af3ffb81000 00000020:00000080:0.0:1788687675.484576:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788687675.484654:0:8541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8541:1875574839608960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788687675.484689:0:8541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687675.484711:0:8541:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6eac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687675.484772:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839608960 00000100:00100000:1.0:1788687675.484776:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839608960 00000100:00100000:1.0:1788687675.484810:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788687675.484817:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:8541:x1875574839608960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687675.484948:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:8541:x1875574839608960:12345-0@lo:502:llog_process_th.0 Request processed in 131us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687675.484955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788687675.485042:0:8541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8541:1875574839608960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788687675.485061:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687675.485066:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687675.485067:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788687675.485071:0:8541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788687675.486087:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788687675.486125:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788687675.486137:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.486149:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687675.486168:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788687675.486171:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3f39f5000 from 4 10000000:01000000:1.0:1788687675.486174:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687675.486208:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.486217:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.486226:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687675.486258:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.486308:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.486346:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839609088 00000100:00100000:1.0:1788687675.486352:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839609088 00000100:00100000:1.0:1788687675.486390:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788687675.486400:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839609088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687675.486411:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687675.486423:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ec400/0xc2ddd83e74448db4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448dad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.486446:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ec400/0xc2ddd83e74448db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448dad expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.486455:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ec400/0xc2ddd83e74448db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448dad expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.486463:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ec400, rc 0) 00000100:00100000:1.0:1788687675.486529:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839609088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687675.486535:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788687675.486580:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83be480 going to sleep for 11 seconds 00000100:00100000:1.0:1788687675.486597:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687675.486612:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.486620:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687675.486665:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.486691:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.486709:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839609216 00000100:00100000:1.0:1788687675.486713:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839609216 00000100:00100000:1.0:1788687675.486733:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788687675.486739:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839609216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.486959:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839609216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687675.486967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788687675.486996:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83be480 going to sleep for 11 seconds 00000100:00100000:1.0:1788687675.487009:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.487040:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.487080:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.487100:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839609344 00000100:00100000:1.0:1788687675.487103:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839609344 00000100:00100000:1.0:1788687675.487130:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788687675.487137:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839609344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.487282:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839609344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687675.487289:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788687675.487319:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83be480 going to sleep for 11 seconds 00000100:00100000:1.0:1788687675.487332:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.487549:0:8542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8542:1875574839609472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687675.487586:0:8542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.487603:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839609472 00000100:00100000:1.0:1788687675.487606:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839609472 00000100:00100000:1.0:1788687675.487626:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788687675.487631:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8542:x1875574839609472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687675.487739:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8542:x1875574839609472:12345-0@lo:502:llog_process_th.0 Request processed in 107us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687675.487746:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788687675.487775:0:8542:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c535cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687675.487787:0:8542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8542:1875574839609472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788687675.487808:0:8542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788687675.487817:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687675.487820:0:8542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788687675.487829:0:8542:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af3f39f5000 00000020:00000080:1.0:1788687675.487832:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788687675.487893:0:8542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8542:1875574839609600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687675.487924:0:8542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.487951:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839609600 00000100:00100000:1.0:1788687675.487955:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839609600 00000100:00100000:1.0:1788687675.487976:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788687675.487982:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8542:x1875574839609600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687675.488088:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:8542:x1875574839609600:12345-0@lo:502:llog_process_th.0 Request processed in 105us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687675.488095:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788687675.488127:0:8542:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fcdb3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687675.488139:0:8542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8542:1875574839609600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788687675.488156:0:8542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788687675.488163:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687675.488165:0:8542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788687675.488170:0:8542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788687675.488216:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788687675.488230:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788687675.488250:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.488261:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687675.488272:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788687675.488274:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3e6e77800 from 4 10000000:01000000:1.0:1788687675.488277:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687675.488298:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.488307:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.488327:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687675.488342:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.488369:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.488390:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fcdb3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687675.488402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839609728 00000100:00100000:1.0:1788687675.488405:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839609728 00000100:00100000:1.0:1788687675.488428:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788687675.488435:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839609728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687675.488444:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687675.488454:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3c13ed800/0xc2ddd83e74448dc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448dbb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.488471:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3c13ed800/0xc2ddd83e74448dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448dbb expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.488497:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3c13ed800/0xc2ddd83e74448dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448dbb expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.488505:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ed800, rc 0) 00000100:00100000:1.0:1788687675.488538:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839609728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687675.488544:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788687675.488579:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687675.488592:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687675.488605:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687675.488642:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.488663:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.488679:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fcdb3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687675.488689:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839609856 00000100:00100000:1.0:1788687675.488692:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839609856 00000100:00100000:1.0:1788687675.488713:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788687675.488719:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839609856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.493542:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839609856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4814us (4869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687675.493557:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788687675.493641:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.493701:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.493754:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.493798:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fcdb3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788687675.494030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839609984 00000100:00100000:3.0:1788687675.494038:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839609984 00000100:00100000:3.0:1788687675.494090:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788687675.494101:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839609984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687675.494299:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839609984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687675.494308:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788687675.494435:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839609984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687675.494919:0:8545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8545:1875574839610112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687675.494965:0:8545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687675.495070:0:8545:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788687675.497309:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839610112 00000100:00100000:2.0:1788687675.497335:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839610112 00000100:00100000:2.0:1788687675.497404:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788687675.497416:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:8545:x1875574839610112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687675.498593:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:8545:x1875574839610112:12345-0@lo:502:llog_process_th.0 Request processed in 1175us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687675.498605:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788687675.499255:0:8545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8545:1875574839610112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788687675.499311:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788687675.499335:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687675.499338:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788687675.499349:0:8545:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af3e6e77800 00000020:00000080:1.0:1788687675.499352:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788687675.499451:0:8545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8545:1875574839610240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687675.499567:0:8545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687675.499598:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839610240 00000100:00100000:3.0:1788687675.499606:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839610240 00000100:00100000:1.0:1788687675.499610:0:8545:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fcdb3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788687675.499646:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788687675.499657:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:8545:x1875574839610240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687675.499918:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:8545:x1875574839610240:12345-0@lo:502:llog_process_th.0 Request processed in 262us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687675.499925:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788687675.500525:0:8545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:8545:1875574839610240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788687675.500550:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788687675.500556:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687675.500558:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788687675.500563:0:8545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788687675.501678:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788687675.501702:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788687675.501714:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687675.501727:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687675.910140:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687675.973890:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788687675.976104:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839610368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687675.976199:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687675.976409:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839610368 00000100:00100000:2.0:1788687675.976418:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839610368 00000100:00100000:2.0:1788687675.976475:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788687675.976515:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839610368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788687675.976554:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687675.976608:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839610368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687675.976616:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788687675.977087:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb820000 x1875574839610368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687675.977108:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839610368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788687676.935660:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687677.958155:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687678.982780:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687679.978605:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687679.978650:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687679.978805:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819658752 00000100:00100000:2.0:1788687679.978815:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819658752 00000100:00100000:2.0:1788687679.978874:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 192 00000100:00100000:2.0:1788687679.978896:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819658752:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687679.978974:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819658752:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 81us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687679.978981:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 192 00000100:00100000:0.0:1788687679.979327:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687679.979351:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687679.979370:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819658880 00000100:00100000:0.0:1788687679.979374:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819658880 00000100:00100000:0.0:1788687679.979412:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:0.0:1788687679.979419:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819658880:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687679.979457:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819658880:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 40us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687679.979464:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:0.0:1788687679.979516:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819659008 00000100:00100000:0.0:1788687679.979520:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819659008 00000100:00100000:0.0:1788687679.979545:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819659136 00000100:00100000:0.0:1788687679.979547:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819659136 00000100:00100000:0.0:1788687679.979564:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:0.0:1788687679.979569:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819659008:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687679.979596:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819659008:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 26us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687679.979602:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:0.0:1788687679.979612:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:0.0:1788687679.979617:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819659136:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687679.979635:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819659136:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 19us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687679.979640:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00080000:0.0:1788687679.979754:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788687679.979765:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788687679.979767:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788687680.005772:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687680.581812:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839610496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687680.581888:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687680.582502:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839611008:0@lo:400:kworker.0 00000100:00100000:3.0:1788687680.582534:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687680.582580:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788687680.582587:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839610624:0@lo:400:kworker.0 00000100:00100000:3.0:1788687680.582619:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687680.582641:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839611136:0@lo:400:kworker.0 00000100:00100000:3.0:1788687680.582669:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687680.582715:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839610752:0@lo:400:kworker.0 00000100:00100000:3.0:1788687680.582744:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687680.582764:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839611264:0@lo:400:kworker.0 00000100:00100000:3.0:1788687680.582787:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687680.582818:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788687680.582824:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839610880:0@lo:400:kworker.0 00000100:00100000:3.0:1788687680.582846:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687680.582882:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839610496 00000100:00100000:3.0:1788687680.582890:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839610496 00000100:00100000:1.0:1788687680.582957:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839611008 00000100:00100000:1.0:1788687680.582963:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839611008 00000100:00100000:1.0:1788687680.583012:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839611264 00000100:00100000:1.0:1788687680.583016:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839611264 00000100:00100000:1.0:1788687680.583050:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788687680.583059:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839611008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687680.583287:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839611008:12345-0@lo:400:kworker.0 Request processed in 229us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687680.583294:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788687680.583308:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788687680.583314:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839611264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687680.583346:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839611264:12345-0@lo:400:kworker.0 Request processed in 32us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687680.583352:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788687680.583378:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839611136 00000100:00100000:1.0:1788687680.583381:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839611136 00000100:00100000:1.0:1788687680.583404:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839610752 00000100:00100000:1.0:1788687680.583406:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839610752 00000100:00100000:1.0:1788687680.583415:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839610880 00000100:00100000:1.0:1788687680.583417:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839610880 00000100:00100000:1.0:1788687680.583427:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788687680.583432:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839611136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687680.583459:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839611136:12345-0@lo:400:kworker.0 Request processed in 27us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687680.583465:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788687680.583477:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788687680.583501:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839610752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687680.583526:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839610752:12345-0@lo:400:kworker.0 Request processed in 26us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687680.583531:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788687680.583541:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788687680.583545:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839610880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687680.583567:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839610880:12345-0@lo:400:kworker.0 Request processed in 22us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687680.583572:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788687680.583586:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788687680.583590:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788687680.583592:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788687680.583624:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839610880:0@lo:400:kworker.0 00000100:00100000:1.0:1788687680.583633:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839610752:0@lo:400:kworker.0 00010000:00080000:1.0:1788687680.583645:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb82fb80 x1875574839611264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687680.583659:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839611264:0@lo:400:kworker.0 00000100:00100000:3.0:1788687680.585428:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788687680.585438:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839610496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788687680.585471:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687680.585545:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839610496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (3658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687680.585552:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788687680.585583:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839610624 00000100:00100000:3.0:1788687680.585588:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839610624 00000100:00100000:3.0:1788687680.585620:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788687680.585626:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839610624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687680.585655:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839610624:12345-0@lo:400:kworker.0 Request processed in 29us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687680.585660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788687680.585713:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839610624:0@lo:400:kworker.0 00000100:00100000:3.0:1788687680.585726:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839611136:0@lo:400:kworker.0 00010000:00080000:3.0:1788687680.585738:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb821c00 x1875574839610496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687680.585762:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839610496:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788687680.585772:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb82d180 x1875574839611008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687680.585781:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839611008:0@lo:400:kworker.0 00000001:02000400:0.0:1788687680.957474:0:8809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788687681.031039:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687681.094947:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788687681.094972:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839611392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687681.095042:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687681.095150:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839611392 00000100:00100000:1.0:1788687681.095159:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839611392 00000100:00100000:1.0:1788687681.095214:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788687681.095224:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839611392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687681.095261:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687681.095308:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839611392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687681.095315:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788687681.095392:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c5b65c00 x1875574839611392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687681.095412:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839611392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788687682.054538:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687683.078136:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687684.110984:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687685.106979:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687685.107020:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687685.107066:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819659392 00000100:00100000:2.0:1788687685.107079:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819659392 00000100:00100000:3.0:1788687685.107082:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819659264 00000100:00100000:3.0:1788687685.107089:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819659264 00000100:00100000:2.0:1788687685.107156:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:3.0:1788687685.107157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 194 00000100:00100000:3.0:1788687685.107171:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819659264:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687685.107183:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819659392:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687685.107247:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819659264:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687685.107253:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 194 00000100:00100000:2.0:1788687685.107309:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819659392:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 130us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687685.107317:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00080000:2.0:1788687685.107335:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687685.108251:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687685.108284:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687685.108307:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819659520 00000100:00100000:3.0:1788687685.109103:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819659520 00000100:00100000:3.0:1788687685.109166:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819659648 00000100:00100000:3.0:1788687685.109169:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819659648 00000100:00100000:3.0:1788687685.109193:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:3.0:1788687685.109203:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2345:x1875574819659520:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:3.0:1788687685.109239:0:8309:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448cfe 00000100:00080000:3.0:1788687685.109251:0:8309:0:(import.c:65:import_set_state_nolock()) ffff9af3c3151800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788687685.109291:0:8309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788687685.109392:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:2.0:1788687685.109404:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2345:x1875574819659648:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:2.0:1788687685.109425:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448d05 00000100:00080000:2.0:1788687685.109432:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9af3c3155000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788687685.109459:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788687685.109851:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+2:2345:x1875574819659648:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 450us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687685.109860:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00010000:00010000:2.0:1788687685.109912:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788687685.110689:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788687685.110694:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788687685.110865:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687685.111267:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+2:2345:x1875574819659520:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 2060us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687685.111288:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00010000:00010000:3.0:1788687685.129692:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687685.701792:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839611520:0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.701872:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687685.701927:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839612032:0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.701954:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687685.701979:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788687685.701996:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839611648:0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.702018:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687685.702034:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839612160:0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.702192:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687685.702223:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839611776:0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.702254:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687685.702273:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788687685.702279:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839611904:0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.702298:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687685.702617:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839611520 00000100:00100000:3.0:1788687685.702625:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839611520 00000100:00100000:3.0:1788687685.702673:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788687685.702682:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839611520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.702736:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839611520:12345-0@lo:400:kworker.0 Request processed in 55us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687685.702743:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788687685.702776:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839612032 00000100:00100000:3.0:1788687685.702780:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839612032 00000100:00100000:3.0:1788687685.702825:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839611648 00000100:00100000:3.0:1788687685.702829:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839611648 00000100:00100000:3.0:1788687685.702842:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839611776 00000100:00100000:3.0:1788687685.702845:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839611776 00000100:00100000:3.0:1788687685.702860:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788687685.702866:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839612032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.702898:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839612032:12345-0@lo:400:kworker.0 Request processed in 32us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687685.702904:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788687685.702916:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788687685.702921:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839611648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.702946:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839611648:12345-0@lo:400:kworker.0 Request processed in 25us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687685.702952:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788687685.702963:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788687685.702969:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839611776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.703013:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839611776:12345-0@lo:400:kworker.0 Request processed in 43us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687685.703019:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788687685.703341:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839612160 00000100:00100000:3.0:1788687685.703346:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839612160 00000100:00100000:3.0:1788687685.703374:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839611904 00000100:00100000:3.0:1788687685.703377:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839611904 00000100:00100000:3.0:1788687685.703395:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788687685.703402:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839612160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.703437:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839612160:12345-0@lo:400:kworker.0 Request processed in 35us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687685.703454:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788687685.703467:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788687685.703473:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839611904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.703533:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839611904:12345-0@lo:400:kworker.0 Request processed in 59us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687685.703539:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788687685.703599:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb82f100 x1875574839611904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687685.703615:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839611904:0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.703627:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839611776:0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.703666:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839611648:0@lo:400:kworker.0 00010000:00080000:3.0:1788687685.703677:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f7a5f480 x1875574839612160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687685.703686:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839612160:0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.703695:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839611520:0@lo:400:kworker.0 00000100:00100000:3.0:1788687685.703705:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839612032:0@lo:400:kworker.0 00000100:00080000:1.0:1788687685.709745:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788687685.709754:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788687685.709757:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788687685.709828:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687685.709847:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839612288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687685.709927:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687685.710139:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839612288 00000100:00100000:1.0:1788687685.710148:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839612288 00000100:00100000:1.0:1788687685.710191:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788687685.710200:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839612288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788687685.710300:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687685.710348:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839612288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687685.710367:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788687685.710582:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c5b65c00 x1875574839612288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687685.710602:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839612288:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788687685.798691:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:2.0:1788687685.798703:0:6712:0:(genops.c:885:class_export_put()) final put ffff9af3c3157800/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:2.0:1788687685.798878:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c3157800/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f for lustre-OST0000 00000020:00000080:2.0:1788687685.799140:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3c3151800 for lustre-OST0000 00010000:00010000:1.0:1788687686.149984:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687686.214249:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687686.214275:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839612416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687686.214347:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687686.214428:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839612416 00000100:00100000:2.0:1788687686.214437:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839612416 00000100:00100000:2.0:1788687686.214531:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788687686.214542:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839612416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788687686.214580:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687686.214637:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839612416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687686.214644:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788687686.214868:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb820700 x1875574839612416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687686.214888:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839612416:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788687686.626209:0:9054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing yml_node 00010000:00010000:3.0:1788687687.173615:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788687687.831118:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:3.0:1788687687.831131:0:7643:0:(genops.c:885:class_export_put()) final put ffff9af3c3150000/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:1.0:1788687687.832696:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c3150000/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f for lustre-OST0001 00000020:00000080:1.0:1788687687.832771:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3c3155000 for lustre-OST0001 00010000:00010000:1.0:1788687688.200766:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687689.221917:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687690.218945:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687690.219001:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687690.219167:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819659904 00000100:00100000:0.0:1788687690.219178:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819659904 00000100:00100000:0.0:1788687690.219326:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:0.0:1788687690.219339:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819659904:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687690.219423:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819659904:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 87us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687690.219430:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:3.0:1788687690.219617:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819659776 00000100:00100000:3.0:1788687690.219639:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819659776 00000100:00100000:3.0:1788687690.219680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 196 00000100:00100000:3.0:1788687690.219688:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2347:x1875574819659776:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687690.219718:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2347:x1875574819659776:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 31us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687690.219725:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 196 00000100:00080000:1.0:1788687690.220407:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788687690.245930:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687690.821891:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839612800:0@lo:400:kworker.0 00000100:00100000:0.0:1788687690.821973:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687690.821981:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839612544:0@lo:400:kworker.0 00000100:00100000:3.0:1788687690.822034:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687690.822036:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788687690.822041:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839612928:0@lo:400:kworker.0 00000100:00100000:3.0:1788687690.822058:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839613056:0@lo:400:kworker.0 00000100:00100000:0.0:1788687690.822074:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687690.822078:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687690.822096:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788687690.822101:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839612672:0@lo:400:kworker.0 00000100:00100000:3.0:1788687690.822121:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687690.822133:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839612544 00000100:00100000:3.0:1788687690.822136:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839613184:0@lo:400:kworker.0 00000100:00100000:0.0:1788687690.822140:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839612544 00000100:00100000:3.0:1788687690.822153:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687690.822176:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839612800 00000100:00100000:3.0:1788687690.822179:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839612800 00000100:00100000:0.0:1788687690.822186:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788687690.822194:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839612544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687690.822213:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839613056 00000100:00100000:3.0:1788687690.822216:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839613056 00000100:00100000:3.0:1788687690.822227:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839612672 00000100:00100000:3.0:1788687690.822230:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839612672 00000100:00100000:0.0:1788687690.822241:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839612544:12345-0@lo:400:kworker.0 Request processed in 47us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687690.822243:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788687690.822248:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788687690.822249:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839612800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687690.822283:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839612800:12345-0@lo:400:kworker.0 Request processed in 34us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687690.822289:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788687690.822294:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839612544:0@lo:400:kworker.0 00000100:00100000:3.0:1788687690.822309:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788687690.822315:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839613056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687690.822320:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839612800:0@lo:400:kworker.0 00000100:00100000:0.0:1788687690.822337:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788687690.822344:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839612672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687690.822345:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839613056:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687690.822350:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788687690.822369:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839612928 00000100:00100000:3.0:1788687690.822372:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839612928 00000100:00100000:0.0:1788687690.822384:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839612672:12345-0@lo:400:kworker.0 Request processed in 40us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687690.822389:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788687690.822394:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839613184 00000100:00100000:3.0:1788687690.822396:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839613184 00000100:00100000:0.0:1788687690.822413:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839612672:0@lo:400:kworker.0 00000100:00100000:3.0:1788687690.822414:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788687690.822420:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839612928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687690.822423:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839613056:0@lo:400:kworker.0 00000100:00100000:3.0:1788687690.822457:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839612928:12345-0@lo:400:kworker.0 Request processed in 37us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687690.822463:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788687690.822466:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee45c380 x1875574839612928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687690.822473:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788687690.822477:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839612928:0@lo:400:kworker.0 00000100:00100000:3.0:1788687690.822479:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839613184:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788687690.822519:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788687690.822523:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788687690.822525:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687690.822527:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839613184:12345-0@lo:400:kworker.0 Request processed in 48us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687690.822533:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788687690.822554:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee45e680 x1875574839613184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687690.822564:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839613184:0@lo:400:kworker.0 00000100:00100000:1.0:1788687690.823136:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839613312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687690.823171:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687690.823246:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839613312 00000100:00100000:2.0:1788687690.823250:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839613312 00000100:00100000:2.0:1788687690.823286:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788687690.823294:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839613312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788687690.823320:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687690.824132:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839613312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 837us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687690.824141:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788687690.824211:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb821c00 x1875574839613312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687690.824230:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839613312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788687691.280383:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687691.337703:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788687691.337887:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839613440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687691.337977:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687691.338250:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839613440 00000100:00100000:2.0:1788687691.338259:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839613440 00000100:00100000:2.0:1788687691.338574:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788687691.338584:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839613440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788687691.338633:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687691.338696:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839613440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687691.338703:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788687691.338787:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb820000 x1875574839613440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687691.338808:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839613440:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788687691.755244:0:9246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:1.0:1788687692.296664:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687693.317948:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687694.348756:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788687694.949245:0:9344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:0.0:1788687695.339845:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687695.340823:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687695.341912:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819660160 00000100:00100000:1.0:1788687695.341926:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819660160 00000100:00100000:1.0:1788687695.342008:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:1.0:1788687695.342022:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819660160:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687695.342111:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819660160:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 93us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687695.342120:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00080000:0.0:1788687695.342253:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687695.345712:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819660032 00000100:00100000:3.0:1788687695.345730:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819660032 00000100:00100000:3.0:1788687695.346539:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 198 00000100:00100000:3.0:1788687695.346555:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819660032:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687695.346647:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819660032:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 98us (6813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687695.346654:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 198 00010000:00010000:2.0:1788687695.371424:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687695.943548:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839613568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687695.943659:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687695.943780:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839613696:0@lo:400:kworker.0 00000100:00100000:3.0:1788687695.943821:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839614080:0@lo:400:kworker.0 00000100:00100000:3.0:1788687695.943861:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687695.944176:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839614080 00000100:00100000:3.0:1788687695.944187:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839614080 00000100:00100000:3.0:1788687695.944263:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788687695.944278:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839613568 00000100:00100000:2.0:1788687695.944282:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839613568 00000100:00100000:2.0:1788687695.944316:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788687695.944324:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839613568:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687695.944352:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839614080:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788687695.944372:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687695.944411:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839614080:12345-0@lo:400:kworker.0 Request processed in 62us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687695.944411:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839613568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687695.944420:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788687695.944420:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788687695.944449:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839613824:0@lo:400:kworker.0 00000100:00100000:2.0:1788687695.944512:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687695.944536:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839614336:0@lo:400:kworker.0 00000100:00100000:2.0:1788687695.944587:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687695.944618:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687695.944625:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839613952:0@lo:400:kworker.0 00000100:00100000:2.0:1788687695.944651:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687695.944682:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839613824 00000100:00100000:2.0:1788687695.944686:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839613824 00000100:00100000:2.0:1788687695.944717:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839613952 00000100:00100000:2.0:1788687695.944720:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839613952 00000100:00100000:2.0:1788687695.944744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788687695.944751:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839613824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687695.944942:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687695.945401:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839614208:0@lo:400:kworker.0 00000100:00100000:0.0:1788687695.945435:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687695.945505:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839614208 00000100:00100000:0.0:1788687695.945511:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839614208 00000100:00100000:0.0:1788687695.945545:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788687695.945554:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839613952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687695.945600:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839613952:12345-0@lo:400:kworker.0 Request processed in 48us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687695.945607:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788687695.945623:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788687695.945629:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839614208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687695.945659:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839614208:12345-0@lo:400:kworker.0 Request processed in 30us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687695.945664:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788687695.945685:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839614336 00000100:00100000:0.0:1788687695.945688:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839614336 00000100:00100000:0.0:1788687695.945719:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788687695.945726:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839614336:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788687695.946923:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788687695.946934:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788687695.946937:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788687695.947001:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb82b800 x1875574839614080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687695.947023:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839614080:0@lo:400:kworker.0 00010000:00080000:3.0:1788687695.947036:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb820000 x1875574839613568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687695.947069:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839613568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788687695.947346:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839613824:12345-0@lo:400:kworker.0 Request processed in 2592us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687695.947359:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788687695.948926:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839613952:0@lo:400:kworker.0 00000100:00100000:1.0:1788687695.948950:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839613824:0@lo:400:kworker.0 00000100:00100000:1.0:1788687695.948990:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839613696 00000100:00100000:1.0:1788687695.948998:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839613696 00000100:00100000:1.0:1788687695.949060:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788687695.949070:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839613696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687695.949158:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839613696:12345-0@lo:400:kworker.0 Request processed in 90us (4216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687695.949166:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788687695.949528:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839613696:0@lo:400:kworker.0 00000100:00100000:1.0:1788687695.949548:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839614208:0@lo:400:kworker.0 00000100:00100000:1.0:1788687695.949599:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839614336:12345-0@lo:400:kworker.0 Request processed in 3873us (5011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687695.949607:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788687695.949838:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb828700 x1875574839614336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687695.949862:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839614336:0@lo:400:kworker.0 00010000:00010000:1.0:1788687696.396411:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687696.454797:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788687696.454841:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839614464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687696.454945:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687696.455220:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839614464 00000100:00100000:2.0:1788687696.455232:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839614464 00000100:00100000:2.0:1788687696.455310:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788687696.455321:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839614464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788687696.455602:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687696.455860:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839614464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 539us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687696.455870:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788687696.455965:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee47bb80 x1875574839614464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687696.456064:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839614464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788687697.417831:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788687697.549034:0:9442:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:1.0:1788687698.437806:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687699.467351:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788687699.504125:0:9491:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 05:41:37 EDT 2026 00000100:00100000:2.0:1788687700.463416:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687700.463596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687700.463636:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819660416 00000100:00100000:2.0:1788687700.463646:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819660416 00000100:00100000:2.0:1788687700.463712:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:2.0:1788687700.463723:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819660416:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687700.463814:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819660416:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 91us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687700.463820:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00080000:2.0:1788687700.463841:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687700.465076:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819660288 00000100:00100000:0.0:1788687700.465086:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819660288 00000100:00100000:0.0:1788687700.465354:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 200 00000100:00100000:0.0:1788687700.465365:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2347:x1875574819660288:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687700.465436:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2347:x1875574819660288:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 73us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687700.465444:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 200 00010000:00010000:1.0:1788687700.494128:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687701.062788:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839614592:0@lo:400:kworker.0 00000100:00100000:1.0:1788687701.063583:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839614720:0@lo:400:kworker.0 00000100:00100000:1.0:1788687701.063733:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687701.063800:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839615232:0@lo:400:kworker.0 00000100:00100000:1.0:1788687701.063832:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687701.063919:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839615232 00000100:00100000:1.0:1788687701.063927:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839615232 00000100:00100000:1.0:1788687701.063985:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788687701.063994:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839615232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687701.064044:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839615232:12345-0@lo:400:kworker.0 Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687701.064051:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788687701.064107:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c2e8bb80 x1875574839615232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687701.064122:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839615232:0@lo:400:kworker.0 00000100:00100000:2.0:1788687701.066517:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839614720 00000100:00100000:2.0:1788687701.066531:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839614720 00000100:00100000:2.0:1788687701.066594:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788687701.066604:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839614720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687701.066691:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839614720:12345-0@lo:400:kworker.0 Request processed in 89us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687701.066705:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788687701.066730:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788687701.069711:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839614848:0@lo:400:kworker.0 00000100:00100000:1.0:1788687701.069797:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687701.069834:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788687701.069842:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839614976:0@lo:400:kworker.0 00000100:00100000:1.0:1788687701.069883:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687701.069925:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839614976 00000100:00100000:1.0:1788687701.069933:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839614976 00000100:00100000:1.0:1788687701.070000:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788687701.070010:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839614976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687701.070351:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839614976:12345-0@lo:400:kworker.0 Request processed in 342us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687701.070359:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788687701.070403:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c2e8aa00 x1875574839614976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687701.070418:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839614976:0@lo:400:kworker.0 00000100:00100000:0.0:1788687701.071083:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687701.071126:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839615104:0@lo:400:kworker.0 00000100:00100000:0.0:1788687701.071174:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687701.071536:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839614592 00000100:00100000:0.0:1788687701.071544:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839614592 00000100:00100000:0.0:1788687701.071587:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788687701.071595:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839614592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687701.071644:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839614592:12345-0@lo:400:kworker.0 Request processed in 50us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687701.071651:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788687701.071684:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839614848 00000100:00100000:0.0:1788687701.071688:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839614848 00000100:00100000:0.0:1788687701.071714:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839615104 00000100:00100000:0.0:1788687701.071717:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839615104 00000100:00100000:0.0:1788687701.071733:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788687701.071738:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839614848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687701.071788:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839614848:12345-0@lo:400:kworker.0 Request processed in 49us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687701.071803:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788687701.071815:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788687701.071821:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839615104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687701.071851:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839615104:12345-0@lo:400:kworker.0 Request processed in 30us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687701.071857:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788687701.071911:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839614848:0@lo:400:kworker.0 00000100:00100000:0.0:1788687701.071938:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839614592:0@lo:400:kworker.0 00000100:00100000:0.0:1788687701.072029:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839615104:0@lo:400:kworker.0 00000100:00100000:0.0:1788687701.073986:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839614720:0@lo:400:kworker.0 00000100:00100000:0.0:1788687701.074322:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788687701.074335:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839615360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687701.074393:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687701.074436:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839615360 00000100:00100000:0.0:1788687701.074442:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839615360 00000100:00100000:0.0:1788687701.074566:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788687701.074577:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839615360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788687701.074615:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687701.074657:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839615360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687701.074664:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788687701.074699:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c2e8b800 x1875574839615360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687701.074730:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839615360:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788687701.082414:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788687701.082425:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788687701.509671:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687701.582876:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839615488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687701.582955:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687701.583076:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839615488 00000100:00100000:2.0:1788687701.583143:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839615488 00000100:00100000:2.0:1788687701.583200:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788687701.583210:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839615488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788687701.583246:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687701.583292:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839615488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687701.583299:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788687701.583376:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb82f100 x1875574839615488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687701.583394:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839615488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788687702.535637:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687703.557914:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687704.583150:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687705.580999:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687705.581067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687705.581146:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819660672 00000100:00100000:0.0:1788687705.581162:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819660672 00000100:00100000:1.0:1788687705.581247:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819660544 00000100:00100000:1.0:1788687705.581253:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819660544 00000100:00100000:0.0:1788687705.581265:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:0.0:1788687705.581282:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819660672:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687705.581294:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 202 00000100:00100000:1.0:1788687705.581305:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2346:x1875574819660544:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687705.581409:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2346:x1875574819660544:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 93us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687705.581418:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 202 00000100:00080000:3.0:1788687705.583892:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687705.588596:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819660672:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 7300us (7595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687705.588629:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00010000:00010000:0.0:1788687705.608110:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687706.181686:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839615616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687706.182203:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839615872:0@lo:400:kworker.0 00000100:00100000:3.0:1788687706.182283:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687706.182360:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839616384:0@lo:400:kworker.0 00000100:00100000:3.0:1788687706.182397:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687706.182438:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788687706.182446:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839616000:0@lo:400:kworker.0 00000100:00100000:3.0:1788687706.182508:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687706.182547:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839615872 00000100:00100000:2.0:1788687706.182558:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839615872 00000100:00100000:2.0:1788687706.183105:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839616000 00000100:00100000:2.0:1788687706.183111:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839616000 00000100:00100000:0.0:1788687706.183267:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687706.183307:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839616128:0@lo:400:kworker.0 00000100:00100000:0.0:1788687706.183335:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687706.183354:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788687706.183361:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839615744:0@lo:400:kworker.0 00000100:00100000:0.0:1788687706.183391:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687706.183426:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839616256:0@lo:400:kworker.0 00000100:00100000:0.0:1788687706.183453:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687706.183502:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839616256 00000100:00100000:0.0:1788687706.183506:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839616256 00000100:00100000:0.0:1788687706.183535:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788687706.183544:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839615872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687706.183616:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839615872:12345-0@lo:400:kworker.0 Request processed in 72us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687706.183624:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788687706.183641:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788687706.183659:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839616000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687706.183686:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839616000:12345-0@lo:400:kworker.0 Request processed in 30us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687706.183691:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788687706.183701:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788687706.183706:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839616256:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788687706.184015:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788687706.184204:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839615616 00000100:00100000:1.0:1788687706.184211:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839615616 00000100:00100000:1.0:1788687706.184256:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788687706.184263:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839615616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788687706.184297:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687706.184346:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839615616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687706.184352:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788687706.184386:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839615744 00000100:00100000:1.0:1788687706.184390:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839615744 00000100:00100000:1.0:1788687706.184414:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788687706.184420:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839615744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687706.184456:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839615744:12345-0@lo:400:kworker.0 Request processed in 37us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687706.184462:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788687706.184635:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839616000:0@lo:400:kworker.0 00000100:00100000:3.0:1788687706.184662:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839615872:0@lo:400:kworker.0 00000100:00100000:3.0:1788687706.184724:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839616384 00000100:00100000:3.0:1788687706.184730:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839616384 00000100:00100000:3.0:1788687706.184770:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839616128 00000100:00100000:3.0:1788687706.184774:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839616128 00000100:00100000:3.0:1788687706.184794:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788687706.184801:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839616384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687706.184850:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839616384:12345-0@lo:400:kworker.0 Request processed in 49us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687706.184858:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788687706.184860:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788687706.184865:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788687706.184877:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788687706.184896:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839616128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687706.184944:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839616128:12345-0@lo:400:kworker.0 Request processed in 62us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687706.184951:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788687706.185094:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee478a80 x1875574839616384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687706.185108:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839616384:0@lo:400:kworker.0 00000100:00100000:1.0:1788687706.185191:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839615744:0@lo:400:kworker.0 00010000:00080000:1.0:1788687706.185207:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee478000 x1875574839616128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687706.185217:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839616128:0@lo:400:kworker.0 00010000:00080000:1.0:1788687706.185229:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c2e88e00 x1875574839615616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687706.185248:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839615616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687706.185492:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839616256:12345-0@lo:400:kworker.0 Request processed in 1769us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687706.185502:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788687706.185652:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839616256:0@lo:400:kworker.0 00010000:00010000:0.0:1788687706.629801:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687706.693831:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839616512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687706.693961:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687706.694041:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839616512 00000100:00100000:1.0:1788687706.694054:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839616512 00000100:00100000:1.0:1788687706.694149:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788687706.694160:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839616512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687706.694202:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687706.694296:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839616512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687706.694304:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788687706.694546:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb828000 x1875574839616512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687706.694576:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839616512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788687707.654222:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687708.679898:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687709.701669:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687710.707137:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687710.707201:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687710.707248:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819660928 00000100:00100000:2.0:1788687710.707263:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819660928 00000100:00100000:2.0:1788687710.707367:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:2.0:1788687710.707380:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee47b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819660928:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687710.707860:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819660800 00000100:00100000:3.0:1788687710.707866:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819660800 00000100:00100000:3.0:1788687710.707907:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 204 00000100:00100000:3.0:1788687710.707916:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819660800:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687710.707977:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819660800:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 62us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687710.707994:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 204 00000100:00080000:3.0:1788687710.714282:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687710.716204:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee47b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819660928:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 8806us (8980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687710.716222:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00010000:00010000:0.0:1788687710.735116:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687711.303818:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839616640:0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.303934:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687711.304004:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839617152:0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.304050:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687711.304084:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788687711.304091:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839616768:0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.304118:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687711.304139:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839617280:0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.304167:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687711.304205:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839616896:0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.304239:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687711.304351:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839617152 00000100:00100000:3.0:1788687711.304365:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839617152 00000100:00100000:1.0:1788687711.304432:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788687711.304442:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839617024:0@lo:400:kworker.0 00000100:00100000:3.0:1788687711.304456:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839616768 00000100:00100000:3.0:1788687711.304462:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839616768 00000100:00100000:1.0:1788687711.304498:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687711.304538:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839616640 00000100:00100000:1.0:1788687711.304543:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839616640 00000100:00100000:1.0:1788687711.304593:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788687711.304604:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839616640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687711.304627:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839616896 00000100:00100000:3.0:1788687711.304632:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839616896 00000100:00100000:3.0:1788687711.304658:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788687711.304668:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839617152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.304677:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839616640:12345-0@lo:400:kworker.0 Request processed in 72us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687711.304687:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788687711.304716:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839617152:12345-0@lo:400:kworker.0 Request processed in 50us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687711.304724:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788687711.304865:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788687711.304875:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839617408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788687711.304917:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687711.304951:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839617408 00000100:00100000:2.0:1788687711.304955:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839617408 00000100:00100000:2.0:1788687711.304993:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788687711.305000:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee47a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839617408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788687711.305040:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687711.305080:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee47a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839617408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687711.305087:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788687711.305134:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee479880 x1875574839617408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687711.305156:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839617408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687711.305720:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788687711.305735:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839616768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.305790:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839616768:12345-0@lo:400:kworker.0 Request processed in 60us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687711.305798:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788687711.305823:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788687711.305830:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839616896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.305908:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839616896:12345-0@lo:400:kworker.0 Request processed in 79us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687711.305915:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788687711.305947:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839617280 00000100:00100000:1.0:1788687711.305954:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839617280 00000100:00100000:1.0:1788687711.306002:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839617024 00000100:00100000:1.0:1788687711.306006:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839617024 00000100:00100000:1.0:1788687711.306025:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788687711.306031:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839617280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.306065:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839617280:12345-0@lo:400:kworker.0 Request processed in 35us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687711.306072:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788687711.306086:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788687711.306092:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839617024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.306119:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839617024:12345-0@lo:400:kworker.0 Request processed in 27us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687711.306125:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788687711.306186:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839616768:0@lo:400:kworker.0 00010000:00080000:1.0:1788687711.306203:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee45ca80 x1875574839617280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687711.306214:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839617280:0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.306225:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839616640:0@lo:400:kworker.0 00000100:00100000:1.0:1788687711.306237:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839617152:0@lo:400:kworker.0 00010000:00080000:2.0:1788687711.307950:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee45c000 x1875574839617024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687711.307978:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839617024:0@lo:400:kworker.0 00000100:00100000:2.0:1788687711.308000:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839616896:0@lo:400:kworker.0 00000100:00080000:3.0:1788687711.309270:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788687711.309282:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788687711.309286:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788687711.752259:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687711.815619:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839617536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687711.815736:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687711.817501:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839617536 00000100:00100000:0.0:1788687711.817518:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839617536 00000100:00100000:0.0:1788687711.817616:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788687711.817628:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839617536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788687711.817684:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687711.817785:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839617536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687711.817793:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788687711.818424:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c2e88e00 x1875574839617536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687711.818454:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839617536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788687712.779692:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687713.805247:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687714.821850:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687715.821229:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687715.821276:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687715.821591:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819661056 00000100:00100000:3.0:1788687715.821602:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819661056 00000100:00100000:3.0:1788687715.821662:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 206 00000100:00100000:3.0:1788687715.821673:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2347:x1875574819661056:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687715.821759:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2347:x1875574819661056:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 87us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687715.821767:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 206 00000100:00100000:1.0:1788687715.822741:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819661184 00000100:00100000:1.0:1788687715.822750:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819661184 00000100:00100000:1.0:1788687715.822828:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:1.0:1788687715.822839:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819661184:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687715.822908:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819661184:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 71us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687715.822915:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00080000:3.0:1788687715.822948:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788687715.845757:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687716.421996:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839617792:0@lo:400:kworker.0 00000100:00100000:0.0:1788687716.422092:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687716.422162:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839618304:0@lo:400:kworker.0 00000100:00100000:0.0:1788687716.422202:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687716.422242:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788687716.422249:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839617664:0@lo:400:kworker.0 00000100:00100000:0.0:1788687716.422281:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687716.422300:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839618176:0@lo:400:kworker.0 00000100:00100000:0.0:1788687716.422322:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687716.422621:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839618048:0@lo:400:kworker.0 00000100:00100000:1.0:1788687716.422656:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687716.422690:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687716.422696:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839617920:0@lo:400:kworker.0 00000100:00100000:1.0:1788687716.422717:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687716.422749:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839618304 00000100:00100000:1.0:1788687716.422757:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839618304 00000100:00100000:1.0:1788687716.422819:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839618048 00000100:00100000:1.0:1788687716.422822:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839618048 00000100:00100000:1.0:1788687716.422845:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788687716.422854:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839618304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687716.422910:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839618304:12345-0@lo:400:kworker.0 Request processed in 56us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687716.422917:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788687716.422935:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788687716.422968:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839618048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687716.423006:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839618048:12345-0@lo:400:kworker.0 Request processed in 40us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687716.423012:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788687716.423033:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839617664 00000100:00100000:1.0:1788687716.423037:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839617664 00000100:00100000:1.0:1788687716.423060:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788687716.423067:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839617664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687716.423099:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839617664:12345-0@lo:400:kworker.0 Request processed in 33us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687716.423106:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788687716.423137:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839617792 00000100:00100000:1.0:1788687716.423141:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839617792 00000100:00100000:1.0:1788687716.423164:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839618176 00000100:00100000:1.0:1788687716.423167:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839618176 00000100:00100000:1.0:1788687716.423182:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839617920 00000100:00100000:1.0:1788687716.423185:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839617920 00000100:00100000:1.0:1788687716.423200:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788687716.423206:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839617792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687716.423237:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839617792:12345-0@lo:400:kworker.0 Request processed in 31us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687716.423243:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788687716.423254:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788687716.423259:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839618176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687716.423281:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839618176:12345-0@lo:400:kworker.0 Request processed in 23us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687716.423286:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788687716.423303:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788687716.423308:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839617920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687716.423331:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839617920:12345-0@lo:400:kworker.0 Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687716.423337:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788687716.423382:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839617920:0@lo:400:kworker.0 00010000:00080000:1.0:1788687716.423396:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb828000 x1875574839618048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687716.423406:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839618048:0@lo:400:kworker.0 00000100:00100000:0.0:1788687716.423587:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839617664:0@lo:400:kworker.0 00000100:00100000:0.0:1788687716.423600:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839618176:0@lo:400:kworker.0 00000100:00100000:0.0:1788687716.423611:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839617792:0@lo:400:kworker.0 00010000:00080000:0.0:1788687716.423622:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82e7b80 x1875574839618304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687716.423639:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839618304:0@lo:400:kworker.0 00000100:00100000:0.0:1788687716.423721:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788687716.423729:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839618432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687716.423764:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687716.423795:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839618432 00000100:00100000:0.0:1788687716.423799:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839618432 00000100:00100000:0.0:1788687716.423828:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788687716.423834:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839618432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788687716.423862:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687716.423898:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839618432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687716.423905:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788687716.423930:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c830e680 x1875574839618432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687716.423956:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839618432:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788687716.424160:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788687716.424166:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788687716.424168:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788687716.870766:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687716.934695:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687716.934721:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839618560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687716.934800:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687716.934905:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839618560 00000100:00100000:0.0:1788687716.934914:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839618560 00000100:00100000:0.0:1788687716.934980:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788687716.934990:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839618560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788687716.935035:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687716.935089:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839618560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687716.935095:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788687716.935137:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c830e680 x1875574839618560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687716.935167:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839618560:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788687717.285470:0:10122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 05:41:55 (1788687715) === 00000100:00100000:2.0:1788687717.791286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687717.791433:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819661312 00000100:00100000:1.0:1788687717.791444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819661312 00000100:00100000:1.0:1788687717.791529:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 208 00000100:00100000:1.0:1788687717.791541:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:8130:x1875574819661312:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788687717.791558:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687717.791576:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38ccc00/0xc2ddd83e74448dc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462a9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687717.791608:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38ccc00/0xc2ddd83e74448dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a9b expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687717.791619:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38ccc00/0xc2ddd83e74448dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a9b expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687717.791640:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38ccc00, rc 0) 00000100:00100000:1.0:1788687717.791702:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:8130:x1875574819661312:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 163us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687717.791715:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 208 00000100:00100000:3.0:1788687717.803885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687717.806607:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819661440 00000100:00100000:0.0:1788687717.806747:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819661440 00000100:00100000:0.0:1788687717.806853:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 209 00000100:00100000:0.0:1788687717.806868:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:8130:x1875574819661440:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788687717.807392:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:8130:x1875574819661440:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 526us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687717.807403:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 209 00000100:00100000:0.0:1788687717.817794:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687717.819797:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819661568 00000100:00100000:2.0:1788687717.819822:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819661568 00000100:00100000:2.0:1788687717.822708:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 210 00000100:00100000:2.0:1788687717.822764:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:8130:x1875574819661568:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788687717.826260:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:8130:x1875574819661568:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 3503us (8533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.826277:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 210 00000100:00100000:2.0:1788687717.839517:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687717.839823:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819661696 00000100:00100000:0.0:1788687717.839841:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819661696 00000100:00100000:0.0:1788687717.839931:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 211 00000100:00100000:0.0:1788687717.839944:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:8134:x1875574819661696:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788687717.840297:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:8134:x1875574819661696:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 355us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687717.840306:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 211 00000100:00100000:0.0:1788687717.862069:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687717.862309:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819661824 00000100:00100000:2.0:1788687717.862322:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819661824 00000100:00100000:2.0:1788687717.862528:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 212 00000100:00100000:2.0:1788687717.862540:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:8134:x1875574819661824:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788687717.862858:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:8134:x1875574819661824:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 320us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.862866:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 212 00000100:00100000:2.0:1788687717.878233:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687717.882537:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819661952 00000100:00100000:1.0:1788687717.882554:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819661952 00000100:00100000:1.0:1788687717.882649:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 213 00000100:00100000:1.0:1788687717.882661:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:8130:x1875574819661952:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788687717.882678:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687717.882700:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cd800/0xc2ddd83e74448dd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ac5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687717.882731:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cd800/0xc2ddd83e74448dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ac5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687717.882743:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cd800/0xc2ddd83e74448dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ac5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687717.882754:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd800, rc 0) 00000100:00100000:1.0:1788687717.882830:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:8130:x1875574819661952:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 171us (4615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687717.882837:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 213 00000100:00100000:1.0:1788687717.886332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687717.886463:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819662080 00000100:00100000:2.0:1788687717.886542:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819662080 00000100:00100000:2.0:1788687717.886633:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 214 00000100:00100000:2.0:1788687717.886646:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:8130:x1875574819662080:12345-192.168.204.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788687717.886686:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788687717.886725:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788687717.886730:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788687717.886734:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788687717.886737:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788687717.891850:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:8130:x1875574819662080:12345-192.168.204.26@tcp:256:mount.lustre.0 Request processed in 5188us (5509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.891883:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 214 00010000:00010000:3.0:1788687717.894259:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687717.912858:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687717.915179:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819662208 00000100:00100000:3.0:1788687717.915213:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819662208 00000100:00100000:2.0:1788687717.915534:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 215 00000100:00100000:2.0:1788687717.915548:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:8130:x1875574819662208:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788687717.915569:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687717.915597:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d9000/0xc2ddd83e74448dd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462acc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687717.915638:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d9000/0xc2ddd83e74448dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462acc expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687717.915652:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d9000/0xc2ddd83e74448dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462acc expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687717.915665:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d9000, rc 0) 00000100:00100000:2.0:1788687717.915773:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:8130:x1875574819662208:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 228us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.915781:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 215 00000100:00100000:3.0:1788687717.918017:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687717.918429:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819662336 00000100:00100000:2.0:1788687717.918442:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819662336 00000100:00100000:2.0:1788687717.918535:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 216 00000100:00100000:2.0:1788687717.918548:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:8130:x1875574819662336:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788687717.919333:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:8130:x1875574819662336:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 783us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.919343:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 216 00000100:00100000:3.0:1788687717.926436:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687717.926608:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819662464 00000100:00100000:1.0:1788687717.926622:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819662464 00000100:00100000:1.0:1788687717.926704:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 217 00000100:00100000:1.0:1788687717.926717:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:8130:x1875574819662464:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788687717.927138:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:8130:x1875574819662464:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 421us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687717.927160:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 217 00000100:00100000:0.0:1788687717.933224:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687717.933384:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819662592 00000100:00100000:2.0:1788687717.933399:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819662592 00000100:00100000:2.0:1788687717.934178:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 218 00000100:00100000:2.0:1788687717.934196:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:8138:x1875574819662592:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788687717.934602:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:8138:x1875574819662592:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 409us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.934612:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 218 00000100:00100000:2.0:1788687717.942164:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687717.942593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819662720 00000100:00100000:0.0:1788687717.942609:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819662720 00000100:00100000:0.0:1788687717.942766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 219 00000100:00100000:0.0:1788687717.942779:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:8138:x1875574819662720:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788687717.943301:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:8138:x1875574819662720:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 520us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687717.943320:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 219 00000100:00100000:3.0:1788687717.950313:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687717.950372:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687717.950775:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819662848 00000100:00100000:1.0:1788687717.950789:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819662848 00000100:00100000:1.0:1788687717.950854:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819663232 00000100:00100000:1.0:1788687717.950858:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819663232 00000100:00080000:2.0:1788687717.951117:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788687717.951192:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:1.0:1788687717.951205:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819663232:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687717.951315:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819663232:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 114us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687717.951323:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:2.0:1788687717.951523:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:2.0:1788687717.951529:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2345:x1875574819662848:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788687717.951562:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2e3c77f5-0083-4021-afe4-5890473fab59@192.168.204.26@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:2.0:1788687717.951618:0:5841:0:(genops.c:1385:class_connect()) connect: client 2e3c77f5-0083-4021-afe4-5890473fab59, cookie 0xc2ddd83e74448dde 00000004:00100000:2.0:1788687717.951670:0:5841:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788687717.953327:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9af3c83c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788687717.953407:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e3c77f5-0083-4021-afe4-5890473fab59+6:2345:x1875574819662848:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 1874us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.953431:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:1.0:1788687717.969270:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687717.969324:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687717.969454:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819663104 00000100:00100000:2.0:1788687717.969468:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819663104 00000100:00100000:2.0:1788687717.969579:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819662976 00000100:00100000:2.0:1788687717.969583:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819662976 00000100:00100000:2.0:1788687717.969611:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:2.0:1788687717.969623:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+7:8130:x1875574819663104:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788687717.969682:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788687717.969799:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+7:8130:x1875574819663104:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 176us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.969830:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:2.0:1788687717.969869:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:2.0:1788687717.969877:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+6:0:x1875574819662976:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788687717.969890:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788687717.969915:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+6:0:x1875574819662976:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 39us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.970138:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00080000:2.0:1788687717.970163:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687717.983300:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687717.983541:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819663360 00000100:00100000:2.0:1788687717.983556:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819663360 00000100:00100000:2.0:1788687717.983798:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:2.0:1788687717.983813:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+6:8130:x1875574819663360:12345-192.168.204.26@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788687717.983959:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+6:8130:x1875574819663360:12345-192.168.204.26@tcp:40:mount.lustre.0 Request processed in 149us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.983980:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788687717.990558:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687717.990605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687717.990635:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687717.991138:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819663744 00000100:00100000:3.0:1788687717.991152:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819663744 00000100:00100000:3.0:1788687717.991234:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:3.0:1788687717.991247:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e3c77f5-0083-4021-afe4-5890473fab59+6:8130:x1875574819663744:12345-192.168.204.26@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788687717.991385:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788687717.991540:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e3c77f5-0083-4021-afe4-5890473fab59+6:8130:x1875574819663744:12345-192.168.204.26@tcp:33:mount.lustre.0 Request processed in 294us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687717.991549:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:2.0:1788687717.994275:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819663488 00000100:00100000:2.0:1788687717.994298:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819663488 00000100:00100000:2.0:1788687717.994371:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819663616 00000100:00100000:2.0:1788687717.994376:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819663616 00000100:00100000:2.0:1788687717.994407:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:2.0:1788687717.994429:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875574819663488:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788687717.994475:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2e3c77f5-0083-4021-afe4-5890473fab59@192.168.204.26@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:2.0:1788687717.994575:0:6687:0:(genops.c:1385:class_connect()) connect: client 2e3c77f5-0083-4021-afe4-5890473fab59, cookie 0xc2ddd83e74448de5 00002000:00100000:2.0:1788687717.994591:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e3c77f5-0083-4021-afe4-5890473fab59/ffff9af3c83c7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788687717.994624:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788687717.995269:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788687717.995320:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9af3c83c1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687717.995531:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:1.0:1788687717.995540:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1875574819663616:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788687717.995575:0:8309:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2e3c77f5-0083-4021-afe4-5890473fab59@192.168.204.26@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:1.0:1788687717.995601:0:8309:0:(genops.c:1385:class_connect()) connect: client 2e3c77f5-0083-4021-afe4-5890473fab59, cookie 0xc2ddd83e74448dec 00002000:00100000:1.0:1788687717.995613:0:8309:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e3c77f5-0083-4021-afe4-5890473fab59/ffff9af3f79cc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788687717.995622:0:8309:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788687717.995797:0:8309:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788687717.995816:0:8309:0:(import.c:65:import_set_state_nolock()) ffff9af3f79ca000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788687717.995901:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e3c77f5-0083-4021-afe4-5890473fab59+6:2345:x1875574819663488:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 1482us (5293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687717.995910:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:1.0:1788687717.999241:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e3c77f5-0083-4021-afe4-5890473fab59+6:2345:x1875574819663616:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 3677us (8582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687717.999262:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000001:00100000:3.0:1788687718.553143:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e3c77f5-0083-4021-afe4-5890473fab59 00010000:00010000:1.0:1788687718.919934:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788687719.571467:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e3c77f5-0083-4021-afe4-5890473fab59 00010000:00010000:1.0:1788687719.945513:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687720.967958:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687721.542992:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839618688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687721.543093:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687721.543202:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839618688 00000100:00100000:3.0:1788687721.543212:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839618688 00000100:00100000:3.0:1788687721.543288:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788687721.543298:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839618688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788687721.543343:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687721.543404:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839618688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687721.543412:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788687721.543436:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788687721.543544:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839618944:0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.543576:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687721.543599:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788687721.543605:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839619072:0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.543629:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687721.543660:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839618944 00000100:00100000:3.0:1788687721.543665:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839618944 00000100:00100000:3.0:1788687721.543696:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839619072 00000100:00100000:3.0:1788687721.543699:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839619072 00000100:00100000:3.0:1788687721.543727:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788687721.543734:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839618944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.543801:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839618944:12345-0@lo:400:kworker.0 Request processed in 67us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687721.543807:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788687721.543820:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788687721.543826:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839619072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.543852:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839619072:12345-0@lo:400:kworker.0 Request processed in 26us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687721.543858:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788687721.543885:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839618816:0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.543921:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687721.543947:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839619328:0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.543972:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687721.543993:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788687721.543997:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839619200:0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.544018:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687721.544044:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839618816 00000100:00100000:3.0:1788687721.544048:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839618816 00000100:00100000:3.0:1788687721.544076:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788687721.544083:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839618816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.544117:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839618816:12345-0@lo:400:kworker.0 Request processed in 35us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687721.544123:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788687721.544153:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839619328 00000100:00100000:3.0:1788687721.544157:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839619328 00000100:00100000:3.0:1788687721.544186:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788687721.544192:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839619328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.544232:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839619328:12345-0@lo:400:kworker.0 Request processed in 39us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687721.544239:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788687721.544258:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788687721.544262:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687721.544295:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839619072:0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.544307:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839618944:0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.544341:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839618816:0@lo:400:kworker.0 00010000:00080000:3.0:1788687721.544365:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82e5880 x1875574839619328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687721.544375:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839619328:0@lo:400:kworker.0 00010000:00080000:3.0:1788687721.544402:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82e7480 x1875574839618688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687721.544418:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839618688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687721.544434:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839619200 00000100:00100000:3.0:1788687721.544437:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839619200 00000100:00100000:3.0:1788687721.544466:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788687721.544472:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839619200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687721.544530:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839619200:12345-0@lo:400:kworker.0 Request processed in 58us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687721.544537:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788687721.544553:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687721.544570:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839619200:0@lo:400:kworker.0 00000001:00100000:2.0:1788687721.648529:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e3c77f5-0083-4021-afe4-5890473fab59 00010000:00010000:1.0:1788687721.993077:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687722.053911:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687722.053936:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839619456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687722.054011:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687722.054151:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839619456 00000100:00100000:2.0:1788687722.054160:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839619456 00000100:00100000:2.0:1788687722.054209:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788687722.054219:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839619456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788687722.054254:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687722.054310:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839619456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687722.054317:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788687722.054417:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c830fb80 x1875574839619456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687722.054435:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839619456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788687723.013812:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687723.499096:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687723.499144:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687723.499176:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687723.499221:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687723.499252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687723.499407:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819664384 00000100:00100000:1.0:1788687723.499417:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819664384 00000100:00100000:1.0:1788687723.499507:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819664256 00000100:00100000:1.0:1788687723.499510:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819664256 00000100:00100000:1.0:1788687723.499537:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:1.0:1788687723.499548:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819664384:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687723.499618:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819664384:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 72us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687723.499627:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:1.0:1788687723.499644:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:1.0:1788687723.499652:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819664256:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687723.499676:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819664256:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687723.499683:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:3.0:1788687723.499762:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819664128 00000100:00100000:3.0:1788687723.499767:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819664128 00000100:00100000:3.0:1788687723.499797:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819664000 00000100:00100000:3.0:1788687723.499800:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819664000 00000100:00100000:3.0:1788687723.499822:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:3.0:1788687723.499830:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819664128:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687723.499863:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819664128:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 34us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687723.499869:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:3.0:1788687723.499890:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:3.0:1788687723.499897:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819664000:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687723.499921:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819664000:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687723.499927:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00080000:3.0:1788687723.499946:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788687723.499950:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788687723.499953:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687723.500161:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819663872 00000100:00100000:2.0:1788687723.500166:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819663872 00000100:00100000:2.0:1788687723.500198:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 221 00000100:00100000:2.0:1788687723.500205:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819663872:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687723.510545:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819663872:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 10314us (11434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687723.510563:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 221 00010000:00010000:1.0:1788687724.038667:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788687724.356114:0:10319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788687725.063326:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687726.085711:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687726.662410:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839619584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687726.662500:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687726.663663:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839619584 00000100:00100000:3.0:1788687726.663676:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839619584 00000100:00100000:3.0:1788687726.663745:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788687726.663761:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839619584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788687726.663798:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687726.663866:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839619584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687726.663873:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788687726.663935:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c830c000 x1875574839619584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687726.663956:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839619584:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788687726.664030:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687726.664395:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839619968:0@lo:400:kworker.0 00000100:00100000:2.0:1788687726.664440:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687726.664473:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687726.664504:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839620096:0@lo:400:kworker.0 00000100:00100000:2.0:1788687726.664529:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687726.664609:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839619840:0@lo:400:kworker.0 00000100:00100000:0.0:1788687726.664640:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687726.664666:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788687726.664671:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839619712:0@lo:400:kworker.0 00000100:00100000:0.0:1788687726.664699:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687726.664719:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839620224:0@lo:400:kworker.0 00000100:00100000:0.0:1788687726.664741:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687726.664767:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839619712 00000100:00100000:0.0:1788687726.664772:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839619712 00000100:00100000:0.0:1788687726.664807:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788687726.664814:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839619712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687726.664863:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839619712:12345-0@lo:400:kworker.0 Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687726.664870:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788687726.664908:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839619712:0@lo:400:kworker.0 00000100:00100000:3.0:1788687726.665581:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839619968 00000100:00100000:3.0:1788687726.665589:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839619968 00000100:00100000:2.0:1788687726.665678:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839620096 00000100:00100000:2.0:1788687726.665683:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839620096 00000100:00100000:1.0:1788687726.665746:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839620224 00000100:00100000:1.0:1788687726.665759:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839620224 00000100:00100000:3.0:1788687726.665812:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839619840 00000100:00100000:3.0:1788687726.665816:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839619840 00000100:00100000:3.0:1788687726.665833:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788687726.665841:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839619968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687726.665902:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839619968:12345-0@lo:400:kworker.0 Request processed in 62us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687726.665909:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788687726.665925:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788687726.665932:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839619840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687726.665963:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839619840:12345-0@lo:400:kworker.0 Request processed in 33us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687726.665969:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788687726.666018:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839619968:0@lo:400:kworker.0 00000100:00100000:3.0:1788687726.666053:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839619840:0@lo:400:kworker.0 00000100:00080000:0.0:1788687726.667265:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788687726.667273:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687726.667462:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788687726.667474:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee47aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839620096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687726.667568:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee47aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839620096:12345-0@lo:400:kworker.0 Request processed in 98us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687726.667575:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788687726.671041:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839620096:0@lo:400:kworker.0 00000100:00100000:1.0:1788687726.672792:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788687726.672808:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839620224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687726.673000:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839620224:12345-0@lo:400:kworker.0 Request processed in 196us (8256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687726.673007:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788687726.677362:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee479c00 x1875574839620224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687726.677381:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839620224:0@lo:400:kworker.0 00010000:00010000:3.0:1788687727.117935:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687727.174859:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839620352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687727.174936:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687727.175033:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839620352 00000100:00100000:1.0:1788687727.175042:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839620352 00000100:00100000:1.0:1788687727.175096:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788687727.175107:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839620352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687727.175146:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687727.180380:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839620352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5266us (5435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687727.180394:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788687727.180547:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c830f800 x1875574839620352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687727.180578:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839620352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788687728.133650:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687728.620285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687728.620379:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687728.620420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687728.620467:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687728.620531:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819664896 00000100:00100000:2.0:1788687728.620542:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819664896 00000100:00100000:2.0:1788687728.620611:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:2.0:1788687728.620622:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819664896:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687728.620698:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819664896:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687728.620706:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:0.0:1788687728.621252:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687728.621277:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819664512 00000100:00100000:0.0:1788687728.621283:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819664512 00000100:00100000:0.0:1788687728.621315:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 223 00000100:00100000:0.0:1788687728.621322:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819664512:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687728.621359:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819664512:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 37us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687728.621367:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 223 00000100:00080000:0.0:1788687728.621394:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788687728.621426:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819665024 00000100:00100000:0.0:1788687728.621444:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819665024 00000100:00100000:0.0:1788687728.621600:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:0.0:1788687728.621608:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819665024:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687728.621641:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819665024:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 34us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687728.621657:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00080000:0.0:1788687728.621735:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788687728.622115:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819664640 00000100:00100000:1.0:1788687728.622121:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819664640 00000100:00100000:1.0:1788687728.622260:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819664768 00000100:00100000:1.0:1788687728.622265:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819664768 00000100:00100000:1.0:1788687728.622291:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:1.0:1788687728.622299:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819664640:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687728.622340:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819664640:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 42us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687728.622346:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:1.0:1788687728.622361:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:1.0:1788687728.622367:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819664768:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687728.622392:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819664768:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687728.622406:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00080000:0.0:1788687728.623338:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788687729.157678:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687730.190950:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687731.205719:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687731.782573:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839620480:0@lo:400:kworker.0 00000100:00100000:3.0:1788687731.782665:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687731.782715:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839620992:0@lo:400:kworker.0 00000100:00100000:3.0:1788687731.782743:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687731.782768:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788687731.782774:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839620608:0@lo:400:kworker.0 00000100:00100000:3.0:1788687731.782799:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687731.782814:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839621120:0@lo:400:kworker.0 00000100:00100000:3.0:1788687731.782842:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687731.782875:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839620736:0@lo:400:kworker.0 00000100:00100000:3.0:1788687731.782900:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687731.782943:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788687731.782949:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839620864:0@lo:400:kworker.0 00000100:00100000:1.0:1788687731.783120:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839620992 00000100:00100000:1.0:1788687731.783128:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839620992 00000100:00100000:1.0:1788687731.783217:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839620608 00000100:00100000:1.0:1788687731.783221:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839620608 00000100:00100000:1.0:1788687731.783235:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839620736 00000100:00100000:1.0:1788687731.783238:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839620736 00000100:00100000:1.0:1788687731.783254:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788687731.783263:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839620992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687731.786612:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839620480 00000100:00100000:2.0:1788687731.786627:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839620480 00000100:00100000:2.0:1788687731.786702:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788687731.786712:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839620480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687731.788831:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788687731.788849:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839620608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687731.788949:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839620608:12345-0@lo:400:kworker.0 Request processed in 106us (6148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687731.788957:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788687731.788985:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788687731.788994:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839620736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687731.789025:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839620736:12345-0@lo:400:kworker.0 Request processed in 33us (6124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687731.789031:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788687731.789052:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788687731.789097:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839620608:0@lo:400:kworker.0 00000100:00100000:1.0:1788687731.789145:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839620992:12345-0@lo:400:kworker.0 Request processed in 5882us (6400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687731.789164:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788687731.789903:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839620992:0@lo:400:kworker.0 00000100:00100000:1.0:1788687731.790330:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788687731.790349:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839621248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687731.790407:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687731.790445:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839621248 00000100:00100000:1.0:1788687731.790452:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839621248 00000100:00100000:1.0:1788687731.790517:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788687731.790526:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839621248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788687731.790566:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687731.790608:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839621248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687731.790615:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788687731.790634:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788687731.790659:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb828a80 x1875574839621248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687731.790685:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839621248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687731.793012:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687731.793088:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839620736:0@lo:400:kworker.0 00000100:00100000:3.0:1788687731.793131:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839621120 00000100:00100000:3.0:1788687731.793138:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839621120 00000100:00100000:3.0:1788687731.793228:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839620864 00000100:00100000:3.0:1788687731.793242:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839620864 00000100:00100000:3.0:1788687731.793269:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788687731.793277:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839621120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687731.793348:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839621120:12345-0@lo:400:kworker.0 Request processed in 72us (10505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687731.793367:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788687731.793385:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788687731.793392:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839620864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687731.793424:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839620864:12345-0@lo:400:kworker.0 Request processed in 34us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687731.793430:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788687731.793500:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82e5c00 x1875574839620864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687731.793511:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839620864:0@lo:400:kworker.0 00000100:00100000:2.0:1788687731.794413:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839620480:12345-0@lo:400:kworker.0 Request processed in 7699us (11745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687731.794424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1788687731.795276:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788687731.795323:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82e7100 x1875574839621120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687731.795338:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839621120:0@lo:400:kworker.0 00000100:00100000:1.0:1788687731.795473:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839620480:0@lo:400:kworker.0 00010000:00010000:0.0:1788687732.229737:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687732.294784:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788687732.299991:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839621376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687732.300103:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687732.300587:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839621376 00000100:00100000:1.0:1788687732.300600:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839621376 00000100:00100000:1.0:1788687732.300862:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788687732.300875:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839621376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687732.300932:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687732.301031:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839621376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687732.301038:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788687732.301168:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82e5c00 x1875574839621376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687732.301192:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839621376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788687733.254033:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687733.749300:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687733.749348:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687733.749378:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687733.749562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687733.749596:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687733.749634:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819665152 00000100:00100000:0.0:1788687733.749647:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819665152 00000100:00100000:0.0:1788687733.749699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 225 00000100:00100000:0.0:1788687733.749710:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819665152:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687733.749786:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819665152:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 77us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687733.749794:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 225 00000100:00100000:0.0:1788687733.749827:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819665536 00000100:00100000:0.0:1788687733.749831:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819665536 00000100:00100000:0.0:1788687733.749869:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819665664 00000100:00100000:0.0:1788687733.749872:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819665664 00000100:00100000:0.0:1788687733.749896:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:0.0:1788687733.749903:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fbad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819665536:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687733.749940:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fbad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819665536:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 37us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687733.749947:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:0.0:1788687733.750212:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:0.0:1788687733.750220:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819665664:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687733.750382:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819665664:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 162us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687733.750389:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00080000:0.0:1788687733.750715:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788687733.750721:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687733.751389:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819665280 00000100:00100000:2.0:1788687733.751400:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819665280 00000100:00100000:2.0:1788687733.751462:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819665408 00000100:00100000:2.0:1788687733.751466:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819665408 00000100:00100000:2.0:1788687733.751503:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:2.0:1788687733.751512:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819665280:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687733.751565:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819665280:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 55us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687733.751573:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:2.0:1788687733.751589:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:2.0:1788687733.751596:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819665408:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687733.751630:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819665408:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 34us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687733.751636:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00080000:0.0:1788687733.751792:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788687734.287637:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687735.301842:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687736.329102:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687736.903623:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839621504:0@lo:400:kworker.0 00000100:00100000:0.0:1788687736.903697:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687736.904023:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839621632:0@lo:400:kworker.0 00000100:00100000:1.0:1788687736.904071:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687736.904094:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839622144:0@lo:400:kworker.0 00000100:00100000:1.0:1788687736.904119:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687736.904272:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687736.904280:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839622016:0@lo:400:kworker.0 00000100:00100000:1.0:1788687736.904319:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687736.904401:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839621760:0@lo:400:kworker.0 00000100:00100000:1.0:1788687736.904425:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687736.904509:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3eea20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839622272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687736.904533:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687736.904552:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788687736.904558:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839621888:0@lo:400:kworker.0 00000100:00100000:1.0:1788687736.904579:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687736.904649:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839621632 00000100:00100000:0.0:1788687736.904657:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839621632 00000100:00100000:0.0:1788687736.904700:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839622016 00000100:00100000:0.0:1788687736.904703:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839622016 00000100:00100000:0.0:1788687736.904727:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839621760 00000100:00100000:0.0:1788687736.904730:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839621760 00000100:00100000:0.0:1788687736.904748:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788687736.904757:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839621632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687736.904783:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839621504 00000100:00100000:2.0:1788687736.904787:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839621504 00000100:00100000:2.0:1788687736.904814:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788687736.904820:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839621504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687736.904825:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839621632:12345-0@lo:400:kworker.0 Request processed in 70us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687736.904831:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788687736.904847:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788687736.904851:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839621504:12345-0@lo:400:kworker.0 Request processed in 32us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687736.904853:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839622016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687736.904857:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788687736.904875:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839622016:12345-0@lo:400:kworker.0 Request processed in 22us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687736.904891:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788687736.904915:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788687736.904920:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839621760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687736.904929:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839622144 00000100:00100000:2.0:1788687736.904933:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839622144 00000100:00100000:0.0:1788687736.904952:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839621760:12345-0@lo:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687736.904956:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839621888 00000100:00100000:0.0:1788687736.904958:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788687736.904959:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839621888 00000100:00080000:0.0:1788687736.904976:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687736.904977:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788687736.904980:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687736.904983:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839622144:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788687736.904983:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687736.905020:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839622144:12345-0@lo:400:kworker.0 Request processed in 36us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687736.905026:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788687736.905037:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788687736.905042:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839621888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687736.905081:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839621888:12345-0@lo:400:kworker.0 Request processed in 38us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687736.905086:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788687736.905347:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839621504:0@lo:400:kworker.0 00000100:00100000:0.0:1788687736.905618:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839622272 00000100:00100000:0.0:1788687736.905623:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839622272 00000100:00100000:0.0:1788687736.905654:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788687736.905661:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839622272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788687736.905686:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687736.905724:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839622272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687736.905731:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788687736.906248:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839622016:0@lo:400:kworker.0 00000100:00100000:1.0:1788687736.906262:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839621632:0@lo:400:kworker.0 00010000:00080000:1.0:1788687736.906277:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb82ad80 x1875574839622144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687736.906289:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839622144:0@lo:400:kworker.0 00010000:00080000:1.0:1788687736.906321:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb829500 x1875574839621888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687736.906351:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839621888:0@lo:400:kworker.0 00000100:00100000:1.0:1788687736.906367:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839621760:0@lo:400:kworker.0 00010000:00080000:1.0:1788687736.906377:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3eea20000 x1875574839622272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687736.906393:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3eea20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839622272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788687737.349815:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687737.418338:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839622400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687737.418412:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687737.418517:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839622400 00000100:00100000:2.0:1788687737.418524:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839622400 00000100:00100000:2.0:1788687737.418577:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788687737.418596:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839622400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788687737.418633:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687737.418683:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839622400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687737.418691:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788687737.418741:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee47b480 x1875574839622400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687737.418761:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839622400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788687738.373716:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687738.864603:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687738.864641:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687738.864672:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687738.864695:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687738.864720:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687738.864750:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819665792 00000100:00100000:2.0:1788687738.864761:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819665792 00000100:00100000:2.0:1788687738.864810:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 227 00000100:00100000:2.0:1788687738.864825:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819665792:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687738.864894:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819665792:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 76us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687738.864901:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 227 00000100:00100000:2.0:1788687738.864934:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819666048 00000100:00100000:2.0:1788687738.864938:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819666048 00000100:00100000:2.0:1788687738.864971:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819665920 00000100:00100000:2.0:1788687738.864974:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819665920 00000100:00100000:2.0:1788687738.864999:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:2.0:1788687738.865005:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819666048:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687738.865053:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819666048:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 48us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687738.865060:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:2.0:1788687738.865072:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:2.0:1788687738.865078:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee47bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819665920:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687738.865101:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee47bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819665920:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 24us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687738.865107:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:2.0:1788687738.865127:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819666176 00000100:00100000:2.0:1788687738.865131:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819666176 00000100:00100000:2.0:1788687738.865164:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819666304 00000100:00100000:2.0:1788687738.865167:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819666304 00000100:00100000:2.0:1788687738.865187:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1788687738.865194:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2345:x1875574819666176:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:2.0:1788687738.865212:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448de5 00000100:00080000:2.0:1788687738.865221:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9af3c83c1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788687738.865256:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788687738.865577:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+2:2345:x1875574819666176:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 383us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687738.865584:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1788687738.865597:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:2.0:1788687738.865604:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2345:x1875574819666304:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:2.0:1788687738.865617:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448dec 00000100:00080000:2.0:1788687738.865622:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9af3f79ca000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788687738.865642:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788687738.865822:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e3c77f5-0083-4021-afe4-5890473fab59+2:2345:x1875574819666304:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 217us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687738.865828:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00080000:2.0:1788687738.865975:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788687738.865979:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788687738.865982:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788687738.866341:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687738.866349:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788687738.988519:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e3c77f5-0083-4021-afe4-5890473fab59 00000020:00000080:3.0:1788687738.988530:0:7643:0:(genops.c:885:class_export_put()) final put ffff9af3f79cc800/2e3c77f5-0083-4021-afe4-5890473fab59 00000020:00000080:1.0:1788687738.988774:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f79cc800/2e3c77f5-0083-4021-afe4-5890473fab59 for lustre-OST0001 00000020:00000080:1.0:1788687738.988828:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3f79ca000 for lustre-OST0001 00010000:00010000:0.0:1788687739.406354:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687740.437914:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687741.446027:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687742.021774:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839622528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687742.021873:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687742.021988:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839622528 00000100:00100000:1.0:1788687742.021997:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839622528 00000100:00080000:3.0:1788687742.022466:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788687742.022612:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788687742.022626:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839622528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788687742.022678:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687742.022805:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839622528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 181us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687742.022813:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788687742.023371:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839622784:0@lo:400:kworker.0 00000100:00100000:2.0:1788687742.023436:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687742.023475:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788687742.023506:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839622912:0@lo:400:kworker.0 00000100:00100000:2.0:1788687742.023531:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687742.023566:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839622784 00000100:00100000:2.0:1788687742.023705:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839622784 00000100:00100000:2.0:1788687742.023755:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839622912 00000100:00100000:2.0:1788687742.023758:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839622912 00000100:00100000:2.0:1788687742.023789:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788687742.023797:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839622784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687742.023847:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839622784:12345-0@lo:400:kworker.0 Request processed in 49us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687742.023854:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788687742.023871:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788687742.023878:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839622912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687742.023906:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839622912:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687742.023912:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788687742.023985:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839622912:0@lo:400:kworker.0 00000100:00100000:2.0:1788687742.023996:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839622784:0@lo:400:kworker.0 00000100:00100000:1.0:1788687742.024570:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839622656:0@lo:400:kworker.0 00000100:00100000:1.0:1788687742.024622:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687742.024658:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839623168:0@lo:400:kworker.0 00000100:00100000:1.0:1788687742.024686:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687742.024711:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687742.024727:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839623040:0@lo:400:kworker.0 00000100:00100000:1.0:1788687742.024754:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687742.024784:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839622656 00000100:00100000:1.0:1788687742.024789:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839622656 00000100:00100000:1.0:1788687742.024829:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788687742.024837:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3311:x1875574839622656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687742.024970:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3311:x1875574839622656:12345-0@lo:400:kworker.0 Request processed in 40us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687742.024979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788687742.025089:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839623168 00000100:00100000:1.0:1788687742.025095:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839623168 00000100:00100000:1.0:1788687742.025131:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788687742.025138:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839623168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687742.025172:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839623168:12345-0@lo:400:kworker.0 Request processed in 35us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687742.025179:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788687742.025657:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839622656:0@lo:400:kworker.0 00010000:00080000:1.0:1788687742.025676:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb82b800 x1875574839623168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687742.025689:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839623168:0@lo:400:kworker.0 00000100:00100000:1.0:1788687742.025724:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839623040 00000100:00100000:1.0:1788687742.025728:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839623040 00000100:00100000:1.0:1788687742.025764:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788687742.025771:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839623040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687742.025816:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839623040:12345-0@lo:400:kworker.0 Request processed in 44us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687742.025835:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788687742.025867:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839623040:0@lo:400:kworker.0 00010000:00080000:3.0:1788687742.032194:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fba8a300 x1875574839622528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687742.032242:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839622528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788687742.032814:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788687742.032823:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1788687742.075985:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e3c77f5-0083-4021-afe4-5890473fab59 00000020:00000080:3.0:1788687742.076000:0:6712:0:(genops.c:885:class_export_put()) final put ffff9af3c83c7000/2e3c77f5-0083-4021-afe4-5890473fab59 00000020:00000080:0.0:1788687742.076169:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c83c7000/2e3c77f5-0083-4021-afe4-5890473fab59 for lustre-OST0000 00000020:00000080:0.0:1788687742.076256:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3c83c1800 for lustre-OST0000 00010000:00010000:1.0:1788687742.470417:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687742.538930:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3eea21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839623296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687742.539009:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687742.539131:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839623296 00000100:00100000:1.0:1788687742.539139:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839623296 00000100:00100000:1.0:1788687742.539192:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788687742.539201:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839623296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687742.539234:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000001:02000400:2.0:1788687742.540707:0:11020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788687742.543370:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839623296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4159us (4350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687742.543385:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788687742.547182:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3eea21c00 x1875574839623296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687742.547212:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3eea21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839623296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788687743.509021:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687743.978431:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687743.978474:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687743.978522:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687743.978561:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819666688 00000100:00100000:0.0:1788687743.978571:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819666688 00000100:00100000:0.0:1788687743.978666:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819666560 00000100:00100000:0.0:1788687743.978670:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819666560 00000100:00100000:0.0:1788687743.978698:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:0.0:1788687743.978710:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819666688:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687743.978784:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819666688:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 78us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687743.978791:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:0.0:1788687743.978808:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:0.0:1788687743.978815:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819666560:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687743.978839:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819666560:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687743.978846:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00080000:0.0:1788687743.978862:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687743.979069:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819666432 00000100:00100000:3.0:1788687743.979075:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819666432 00000100:00100000:3.0:1788687743.979112:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 229 00000100:00100000:3.0:1788687743.979119:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819666432:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687743.979147:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819666432:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 29us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687743.979153:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 229 00010000:00010000:2.0:1788687744.519137:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687745.541807:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788687746.574538:0:11169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8ed93150 20000000:00000080:0.0:1788687746.574557:0:11169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af3f7a95c00 uarg=0000000000000000 20000000:01000000:0.0:1788687746.574601:0:11169:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788687746.574608:0:11169:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788687746.574613:0:11169:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00010000:00010000:1.0:1788687746.575731:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788687746.577140:0:11170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788687746.586819:0:11169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788687746.600655:0:11169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788687746.601001:0:11169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.601025:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.601040:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448d9f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.601048:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c13ec400/0xc2ddd83e74448db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448dad expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.601055:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3c13ed800/0xc2ddd83e74448dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448dbb expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.601085:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4021d9000/0xc2ddd83e74448dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462acc expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.601093:0:11169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.601472:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4021d9000/0xc2ddd83e74448dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462acc expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.602049:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af4021d9000/0xc2ddd83e74448dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462acc expref: 12 pid: 5833 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687746.602067:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875574839623424:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687746.602400:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c13ed800/0xc2ddd83e74448dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448dbb expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.602410:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c13ed800/0xc2ddd83e74448dc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448dbb expref: 18 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687746.602420:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba89500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875574839623552:0@lo:104: 00000100:00100000:1.0:1788687746.602462:0:11169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788687746.602527:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c13ec400/0xc2ddd83e74448db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448dad expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.602535:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c13ec400/0xc2ddd83e74448db4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448dad expref: 18 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687746.602544:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba88700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875574839623680:0@lo:104: 00000100:00100000:1.0:1788687746.602574:0:11169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788687746.602601:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448d9f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.602625:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448da6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448d9f expref: 18 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687746.602634:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba89f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875574839623808:0@lo:104: 00000100:00100000:1.0:1788687746.602657:0:11169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788687746.602677:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.602686:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 12 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687746.602694:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875574839623936:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687746.602717:0:11169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788687746.602937:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839623552 00000100:00100000:3.0:1788687746.602946:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839623552 00000100:00100000:3.0:1788687746.602986:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839623680 00000100:00100000:3.0:1788687746.602989:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839623680 00000100:00100000:3.0:1788687746.603000:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839623808 00000100:00100000:3.0:1788687746.603002:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839623808 00000100:00100000:3.0:1788687746.603013:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788687746.603022:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:11169:x1875574839623552:12345-0@lo:104: 00010000:00010000:3.0:1788687746.603041:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603108:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788687746.603114:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:11169:x1875574839623552:12345-0@lo:104: Request processed in 94us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687746.603121:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788687746.603140:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788687746.603146:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:11169:x1875574839623680:12345-0@lo:104: 00010000:00010000:3.0:1788687746.603153:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603186:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788687746.603191:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:11169:x1875574839623680:12345-0@lo:104: Request processed in 46us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687746.603197:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788687746.603208:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788687746.603214:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:11169:x1875574839623808:12345-0@lo:104: 00010000:00010000:3.0:1788687746.603221:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603246:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788687746.603251:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:11169:x1875574839623808:12345-0@lo:104: Request processed in 38us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687746.603256:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788687746.603274:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788687746.603280:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603294:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ed000 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:3.0:1788687746.603299:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603307:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788687746.603315:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687746.603321:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788687746.603357:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603375:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788687746.603395:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603403:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed000/0xc2ddd83e74448dbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448dc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603417:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788687746.603420:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603426:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ed200 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:3.0:1788687746.603429:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603445:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788687746.603451:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687746.603456:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788687746.603469:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603475:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788687746.603521:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603527:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c13ed200/0xc2ddd83e74448dad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448db4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603536:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687746.603540:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603545:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aaca00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:3.0:1788687746.603548:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603554:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788687746.603560:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687746.603572:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788687746.603586:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603592:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788687746.603598:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603768:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448d9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448da6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.603784:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687746.603785:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687746.603787:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687746.603795:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687746.603809:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839624064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687746.603847:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687746.603905:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839624192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687746.603928:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687746.603945:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788687746.603949:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839624320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687746.603964:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687746.603989:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839624064 00000100:00100000:3.0:1788687746.603993:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839624064 00010000:00010000:3.0:1788687746.604012:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c13ed800/0xc2ddd83e74448dc2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448dbb expref: 19 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687746.604032:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839624192 00000100:00100000:3.0:1788687746.604040:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839624192 00010000:00010000:3.0:1788687746.604050:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c13ec400/0xc2ddd83e74448db4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448dad expref: 20 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687746.604060:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839624320 00000100:00100000:3.0:1788687746.604062:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839624320 00010000:00010000:3.0:1788687746.604070:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448da6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448d9f expref: 21 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687746.604081:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788687746.604086:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c690b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+21:3313:x1875574839624064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687746.604096:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687746.604100:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c13ed800/0xc2ddd83e74448dc2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448dbb expref: 21 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.604109:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c13ed800/0xc2ddd83e74448dc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448dbb expref: 21 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.604125:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687746.604149:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c690b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+21:3313:x1875574839624064:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687746.604155:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788687746.604193:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788687746.604199:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+20:3310:x1875574839624192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687746.604206:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687746.604210:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c13ec400/0xc2ddd83e74448db4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448dad expref: 20 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.604219:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c13ec400/0xc2ddd83e74448db4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448dad expref: 20 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.604242:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687746.604269:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+20:3310:x1875574839624192:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687746.604275:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788687746.604287:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788687746.604293:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839624320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687746.604300:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687746.604304:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448da6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448d9f expref: 19 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.604312:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448da6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448d9f expref: 19 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.604321:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687746.604341:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839624320:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687746.604347:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788687746.604806:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ed800/0xc2ddd83e74448dc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448dbb expref: 18 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687746.604822:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba89500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875574839623552:0@lo:104: 00010000:00010000:1.0:1788687746.604840:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ec400/0xc2ddd83e74448db4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448dad expref: 17 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687746.604847:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba88700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875574839623680:0@lo:104: 00010000:00010000:1.0:1788687746.604858:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ec800/0xc2ddd83e74448da6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448d9f expref: 16 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687746.604877:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba89f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875574839623808:0@lo:104: 00000100:00100000:3.0:1788687746.605016:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839624064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687746.605045:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839624320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687746.605052:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839624192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788687746.607469:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875574839623424:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687746.607521:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875574839623936:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687746.607555:0:11169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687746.608102:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687746.608183:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819666816 00000100:00100000:3.0:1788687746.608191:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819666816 00010000:00010000:3.0:1788687746.608228:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4021d9000/0xc2ddd83e74448dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462acc expref: 13 pid: 5833 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687746.608269:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:3.0:1788687746.608303:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2348:x1875574819666816:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687746.608318:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687746.608325:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4021d9000/0xc2ddd83e74448dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462acc expref: 13 pid: 5833 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.608338:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4021d9000/0xc2ddd83e74448dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462acc expref: 13 pid: 5833 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.608357:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d9000/0xc2ddd83e74448dd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462acc expref: 13 pid: 5833 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687746.608374:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687746.608435:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:2348:x1875574819666816:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 142us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687746.608442:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:0.0:1788687746.615542:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687746.615673:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819666944 00000100:00100000:3.0:1788687746.615685:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819666944 00010000:00010000:3.0:1788687746.615726:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 12 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687746.615862:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:1.0:1788687746.615888:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:2348:x1875574819666944:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687746.615905:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687746.615911:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 12 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.615924:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 12 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.615942:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d9800/0xc2ddd83e74448d98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a94 expref: 12 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.615961:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.615971:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.615988:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.615996:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.616020:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.616027:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.616033:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687746.616037:0:5825:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.616046:0:5825:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.616073:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687746.616084:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687746.616148:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:2348:x1875574819666944:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 263us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687746.616156:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00010000:00010000:2.0:1788687746.616517:0:11169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687746.616528:0:11169:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687746.616535:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448df3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687747.141956:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839624448:0@lo:400:kworker.0 00000100:00100000:2.0:1788687747.142082:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839624704:0@lo:400:kworker.0 00000100:00100000:2.0:1788687747.142124:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687747.142207:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687747.142214:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839624832:0@lo:400:kworker.0 00000100:00100000:2.0:1788687747.142241:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839624576:0@lo:400:kworker.0 00000100:00100000:2.0:1788687747.142273:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839624704 00000100:00100000:2.0:1788687747.142279:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839624704 00000100:00100000:2.0:1788687747.142336:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788687747.142377:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839624704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687747.142430:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839624704:12345-0@lo:400:kworker.0 Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687747.142437:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788687747.142458:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788687747.142538:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687747.142635:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839624960:0@lo:400:kworker.0 00000100:00100000:3.0:1788687747.142660:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687747.142684:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788687747.142690:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839625088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687747.142713:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687747.142745:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839625088 00000100:00100000:3.0:1788687747.142756:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839625088 00000100:00100000:3.0:1788687747.142784:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788687747.142790:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839625088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788687747.142814:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687747.142849:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839625088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687747.142867:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788687747.142885:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839624960 00000100:00100000:3.0:1788687747.142889:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839624960 00000100:00100000:3.0:1788687747.142918:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788687747.142924:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839624960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687747.142954:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839624960:12345-0@lo:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687747.142960:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788687747.142975:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788687747.143000:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fba8b480 x1875574839625088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687747.143018:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687747.143019:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839625088:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788687747.143031:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82e7100 x1875574839624960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687747.143040:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839624960:0@lo:400:kworker.0 00000100:00100000:0.0:1788687747.153723:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687747.162476:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839624448 00000100:00100000:1.0:1788687747.162507:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839624448 00000100:00100000:1.0:1788687747.162569:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839624576 00000100:00100000:1.0:1788687747.162573:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839624576 00000100:00100000:1.0:1788687747.162792:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788687747.162804:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839624448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687747.162921:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839624448:12345-0@lo:400:kworker.0 Request processed in 120us (20382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687747.162930:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788687747.162977:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788687747.162985:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839624576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687747.163024:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839624576:12345-0@lo:400:kworker.0 Request processed in 41us (20007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687747.163030:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1788687747.170501:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82e4000 x1875574839624704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687747.170521:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839624704:0@lo:400:kworker.0 00000100:00100000:2.0:1788687747.173472:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839624832 00000100:00100000:2.0:1788687747.173502:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839624832 00000100:00100000:2.0:1788687747.175022:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788687747.175105:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839624832:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788687747.175280:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687747.175296:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839624832:12345-0@lo:400:kworker.0 Request processed in 260us (21578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687747.175306:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788687747.175307:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839624576:0@lo:400:kworker.0 00000100:00100000:0.0:1788687747.175313:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839624448:0@lo:400:kworker.0 00000100:00100000:2.0:1788687747.175604:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839624832:0@lo:400:kworker.0 00010000:00010000:3.0:1788687747.590596:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687747.653895:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788687747.653920:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3eea22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839625216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687747.653988:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687747.654173:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839625216 00000100:00100000:0.0:1788687747.654184:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839625216 00000100:00100000:3.0:1788687747.654269:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788687747.654288:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839625216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788687747.654325:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687747.654389:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839625216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687747.654396:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788687747.654807:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3eea22d80 x1875574839625216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687747.654828:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3eea22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839625216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687748.144150:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687748.144187:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819667072 00000100:00100000:1.0:1788687748.144197:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819667072 00000100:00100000:1.0:1788687748.144246:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 230 00000100:00100000:1.0:1788687748.144256:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:5586:x1875574819667072:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687748.144272:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687748.144290:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74448dfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462af6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.144319:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74448dfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462af6 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.144330:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74448dfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462af6 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.144349:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc600, rc 0) 00000100:00100000:1.0:1788687748.144406:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819667072:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 149us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687748.144414:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 230 00000100:00100000:0.0:1788687748.150333:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687748.152133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819667200 00000100:00100000:2.0:1788687748.152149:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819667200 00000100:00100000:2.0:1788687748.152212:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 231 00000100:00100000:2.0:1788687748.152222:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819667200:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687748.152520:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819667200:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 299us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687748.152533:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 231 00000100:00100000:2.0:1788687748.167832:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687748.167966:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819667328 00000100:00100000:1.0:1788687748.167978:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819667328 00000100:00100000:1.0:1788687748.168051:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 232 00000100:00100000:1.0:1788687748.168062:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819667328:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.171074:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819667328:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 3001us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687748.171090:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 232 00000100:00100000:0.0:1788687748.201007:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687748.201099:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819667456 00000100:00100000:2.0:1788687748.201110:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819667456 00000100:00100000:2.0:1788687748.201175:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 233 00000100:00100000:2.0:1788687748.201185:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819667456:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687748.201203:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687748.201222:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448e01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462afd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687748.201255:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462afd expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687748.201267:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462afd expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687748.201277:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d8200, rc 0) 00000100:00100000:2.0:1788687748.201350:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:5586:x1875574819667456:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 167us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687748.201358:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 233 00000100:00100000:0.0:1788687748.203296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687748.203563:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819667584 00000100:00100000:3.0:1788687748.203573:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819667584 00000100:00100000:3.0:1788687748.203624:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 234 00000100:00100000:3.0:1788687748.203635:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:5586:x1875574819667584:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687748.203973:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:5586:x1875574819667584:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 338us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687748.203981:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 234 00000100:00100000:3.0:1788687748.205497:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687748.205631:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819667712 00000100:00100000:0.0:1788687748.205697:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819667712 00000100:00100000:0.0:1788687748.205749:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 235 00000100:00100000:0.0:1788687748.205759:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:5586:x1875574819667712:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687748.206595:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:5586:x1875574819667712:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 834us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687748.206606:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 235 10000000:01000000:0.0:1788687748.553746:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788687748.553754:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3ffb81000 from 7 10000000:01000000:0.0:1788687748.553760:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788687748.553816:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687748.553839:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687748.553851:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687748.553902:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3eea22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788687748.553985:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687748.554050:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d01710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687748.554121:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839625344 00000100:00100000:2.0:1788687748.554131:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839625344 00000100:00100000:2.0:1788687748.554195:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788687748.554205:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839625344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687748.554219:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687748.554235:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4021d8a00/0xc2ddd83e74448e0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448e08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687748.554274:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4021d8a00/0xc2ddd83e74448e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448e08 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687748.554286:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4021d8a00/0xc2ddd83e74448e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448e08 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687748.554296:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d8a00, rc 0) 00000100:00100000:2.0:1788687748.554340:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839625344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687748.554346:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788687748.555562:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3eea22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788687748.555584:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687748.555594:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687748.555664:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3eea22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687748.555709:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687748.555752:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d01710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687748.556049:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839625472 00000100:00100000:2.0:1788687748.556056:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839625472 00000100:00100000:2.0:1788687748.556103:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788687748.556112:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839625472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687748.556401:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839625472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687748.556409:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788687748.556736:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3eea22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.556776:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.556822:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687748.556864:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c2c2b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788687748.556877:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839625600 00000100:00100000:1.0:1788687748.556881:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839625600 00000100:00100000:1.0:1788687748.556908:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788687748.556914:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839625600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.557063:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839625600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687748.557070:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788687748.557111:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788687748.557774:0:11226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788687748.557841:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788687748.557859:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788687748.557868:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.557879:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687748.557902:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788687748.557905:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3f39f5000 from 7 10000000:01000000:1.0:1788687748.557907:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687748.557934:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.557942:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.557952:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687748.557968:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.558005:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687748.558023:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6e17900 going to sleep for 11 seconds 00000100:00100000:1.0:1788687748.558038:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839625728 00000100:00100000:1.0:1788687748.558042:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839625728 00000100:00100000:1.0:1788687748.558070:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788687748.558078:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839625728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687748.558087:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687748.558099:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cde00/0xc2ddd83e74448e1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448e16 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.558120:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cde00/0xc2ddd83e74448e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448e16 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.558131:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cde00/0xc2ddd83e74448e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448e16 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.558151:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cde00, rc 0) 00000100:00100000:1.0:1788687748.558185:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839625728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687748.558191:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788687748.558228:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687748.558241:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.558249:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687748.558290:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.558314:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687748.558327:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6e17900 going to sleep for 11 seconds 00000100:00100000:1.0:1788687748.558337:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839625856 00000100:00100000:1.0:1788687748.558340:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839625856 00000100:00100000:1.0:1788687748.558359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788687748.558365:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839625856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.558612:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839625856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687748.558619:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788687748.558651:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.558676:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.558713:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687748.558733:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6e17900 going to sleep for 11 seconds 00000100:00100000:1.0:1788687748.558744:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839625984 00000100:00100000:1.0:1788687748.558748:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839625984 00000100:00100000:1.0:1788687748.558769:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788687748.558775:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839625984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.558917:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839625984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687748.558923:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788687748.558960:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839625984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788687748.566734:0:11227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788687748.566967:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788687748.566990:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788687748.567003:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687748.567015:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687748.567027:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788687748.567030:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3e6e77800 from 7 10000000:01000000:0.0:1788687748.567033:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788687748.567137:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687748.567164:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687748.567176:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687748.567207:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3eea22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839626112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788687748.567278:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687748.567322:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d0171180 going to sleep for 11 seconds 00000100:00100000:1.0:1788687748.567810:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839626112 00000100:00100000:1.0:1788687748.567819:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839626112 00000100:00100000:1.0:1788687748.567875:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788687748.567885:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839626112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687748.567899:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687748.567922:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74448e2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448e24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.567955:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74448e2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448e24 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.567967:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74448e2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448e24 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687748.567980:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc400, rc 0) 00000100:00100000:1.0:1788687748.568671:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839626112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 784us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687748.568680:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788687748.579532:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3eea22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839626112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687748.579565:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687748.579578:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687748.579667:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839626240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687748.579728:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687748.579787:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788687748.580034:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839626240 00000100:00100000:3.0:1788687748.580042:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839626240 00000100:00100000:3.0:1788687748.580095:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788687748.580104:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839626240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687748.580413:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839626240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687748.580423:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788687748.580675:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839626240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687748.580716:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839626368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788687748.580760:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687748.580792:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788687748.580848:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839626368 00000100:00100000:1.0:1788687748.580854:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839626368 00000100:00100000:1.0:1788687748.580890:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788687748.580898:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839626368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687748.581055:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839626368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687748.581061:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788687748.583474:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839626368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788687748.585650:0:11228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788687748.596810:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788687748.596950:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788687748.596963:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687748.596975:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687748.614320:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687749.101579:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687749.101619:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687749.101649:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687749.101681:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819668096 00000100:00100000:0.0:1788687749.101691:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819668096 00000100:00100000:0.0:1788687749.101972:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819667968 00000100:00100000:0.0:1788687749.101976:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819667968 00000100:00100000:0.0:1788687749.102008:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:0.0:1788687749.102018:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2348:x1875574819668096:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687749.102098:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2348:x1875574819668096:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 81us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687749.102106:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:0.0:1788687749.102123:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:0.0:1788687749.102130:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819667968:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687749.102154:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819667968:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687749.102160:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00080000:0.0:1788687749.102188:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788687749.102519:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819667840 00000100:00100000:1.0:1788687749.102525:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819667840 00000100:00100000:1.0:1788687749.102564:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 245 00000100:00100000:1.0:1788687749.102572:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2348:x1875574819667840:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687749.102611:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2348:x1875574819667840:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 41us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687749.102619:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 245 00010000:00010000:3.0:1788687749.637992:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687750.669918:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788687751.043651:0:11367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788687751.685622:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687752.263792:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839626496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687752.264057:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687752.264364:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839626496 00000100:00100000:0.0:1788687752.264373:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839626496 00000100:00100000:0.0:1788687752.264437:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788687752.264448:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839626496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788687752.264517:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687752.264585:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839626496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687752.264593:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788687752.264620:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788687752.264660:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fba8b100 x1875574839626496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687752.264682:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839626496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687752.264707:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839627008:0@lo:400:kworker.0 00000100:00100000:0.0:1788687752.264766:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687752.264806:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788687752.264813:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839626880:0@lo:400:kworker.0 00000100:00100000:0.0:1788687752.264840:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687752.265179:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839627008 00000100:00100000:0.0:1788687752.265235:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839627008 00000100:00100000:0.0:1788687752.265341:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839626880 00000100:00100000:0.0:1788687752.265345:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839626880 00000100:00100000:0.0:1788687752.265374:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788687752.265382:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839627008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687752.265427:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839627008:12345-0@lo:400:kworker.0 Request processed in 46us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687752.265434:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788687752.265460:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788687752.265466:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839626880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687752.265517:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839626880:12345-0@lo:400:kworker.0 Request processed in 51us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687752.265524:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788687752.265549:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687752.265575:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839626880:0@lo:400:kworker.0 00000100:00100000:0.0:1788687752.265589:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839627008:0@lo:400:kworker.0 00000100:00100000:2.0:1788687752.265593:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839626624:0@lo:400:kworker.0 00000100:00100000:2.0:1788687752.265636:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687752.265677:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839627136:0@lo:400:kworker.0 00000100:00100000:2.0:1788687752.265705:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687752.265730:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788687752.265737:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839626752:0@lo:400:kworker.0 00000100:00100000:2.0:1788687752.265778:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687752.265819:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839626752 00000100:00100000:2.0:1788687752.265823:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839626752 00000100:00100000:0.0:1788687752.266120:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839626624 00000100:00100000:0.0:1788687752.266125:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839626624 00000100:00100000:0.0:1788687752.266166:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788687752.266175:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839626624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687752.266393:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839626624:12345-0@lo:400:kworker.0 Request processed in 218us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687752.266400:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788687752.266451:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788687752.266461:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839626752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687752.266534:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839626752:12345-0@lo:400:kworker.0 Request processed in 75us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687752.266542:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788687752.266568:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839627136 00000100:00100000:2.0:1788687752.266573:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839627136 00000100:00100000:2.0:1788687752.266625:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788687752.266641:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee47b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839627136:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788687752.266673:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687752.266721:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee47b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839627136:12345-0@lo:400:kworker.0 Request processed in 83us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687752.266728:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788687752.266777:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839626752:0@lo:400:kworker.0 00000100:00100000:2.0:1788687752.266789:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839626624:0@lo:400:kworker.0 00010000:00080000:2.0:1788687752.266801:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ee47a680 x1875574839627136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687752.266811:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839627136:0@lo:400:kworker.0 00010000:00010000:3.0:1788687752.711556:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687752.774928:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788687752.774951:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3eea23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839627264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687752.775020:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687752.775091:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839627264 00000100:00100000:0.0:1788687752.775098:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839627264 00000100:00100000:0.0:1788687752.775149:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788687752.775161:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839627264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788687752.775200:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687752.775255:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839627264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687752.775274:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788687752.775440:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3eea23b80 x1875574839627264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687752.775462:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3eea23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839627264:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788687753.734684:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687754.222196:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687754.222283:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687754.222535:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687754.222619:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819668224 00000100:00100000:1.0:1788687754.222631:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819668224 00000100:00100000:1.0:1788687754.222689:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 247 00000100:00100000:1.0:1788687754.222700:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2349:x1875574819668224:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687754.222786:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2349:x1875574819668224:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 88us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687754.222802:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 247 00000100:00100000:2.0:1788687754.225868:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819668480 00000100:00100000:2.0:1788687754.225885:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819668480 00000100:00100000:2.0:1788687754.226070:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819668352 00000100:00100000:2.0:1788687754.226075:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819668352 00000100:00100000:3.0:1788687754.226169:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:3.0:1788687754.226182:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+5:2349:x1875574819668480:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687754.226284:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+5:2349:x1875574819668480:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 106us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687754.226292:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00080000:0.0:1788687754.227641:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687754.227797:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 98 00000100:00100000:2.0:1788687754.227810:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819668352:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687754.227874:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819668352:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 67us (5339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687754.227881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 98 00000001:02000400:2.0:1788687754.306030:0:11467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 05:42:32 (1788687752) === 00000100:00100000:0.0:1788687754.486223:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687754.486566:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687754.486836:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819668736 00000100:00100000:2.0:1788687754.486848:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819668736 00000100:00100000:2.0:1788687754.486924:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:2.0:1788687754.486936:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:9684:x1875574819668736:12345-192.168.204.26@tcp:700:mkdir.0 00000100:00100000:2.0:1788687754.487186:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:9684:x1875574819668736:12345-192.168.204.26@tcp:700:mkdir.0 Request processed in 251us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687754.487212:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:3.0:1788687754.490801:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819668608 00000100:00100000:3.0:1788687754.490821:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819668608 00000100:00100000:2.0:1788687754.491415:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1788687754.491427:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819668608:12345-192.168.204.26@tcp:41:mkdir.0 00000004:00000024:2.0:1788687754.491504:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788687754.491603:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819668608:12345-192.168.204.26@tcp:41:mkdir.0 Request processed in 176us (5389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687754.491612:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1788687754.494909:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687754.495141:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819668992 00000100:00100000:0.0:1788687754.495155:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819668992 00000100:00100000:0.0:1788687754.495228:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:0.0:1788687754.495321:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee47a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:9684:x1875574819668992:12345-192.168.204.26@tcp:36:mkdir.0 00010000:00010000:0.0:1788687754.495392:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687754.495519:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c0031000/0xc2ddd83e74448d13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a7f expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.495546:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736400) 00010000:00010000:0.0:1788687754.495560:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788687754.497890:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448e32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.497915:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448e32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.497928:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448e32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.497988:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.498159:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.498167:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687754.502390:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788687754.502419:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448e32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.502431:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448e32 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.502440:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448e32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.502448:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687754.502454:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448e32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.502463:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448e32 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.502596:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736c00) 00010000:00010000:2.0:1788687754.502600:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687754.502606:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448e32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.502620:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448e32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788687754.502789:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c01847b reply state 000000004e37712f transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687754.502801:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788687754.502981:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee47a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:9684:x1875574819668992:12345-192.168.204.26@tcp:36:mkdir.0 Request processed in 7659us (8076us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788687754.502991:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00010000:00010000:2.0:1788687754.508893:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.508916:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.508924:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.508930:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eda00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687754.508936:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.508945:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.508964:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9af3d2736e00) 00010000:00010000:2.0:1788687754.508968:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687754.508972:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.508998:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74448e39 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687754.521886:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.524156:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819669120 00000100:00100000:3.0:1788687754.524177:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819669120 00000100:00100000:3.0:1788687754.524269:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788687754.524281:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee47ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:9685:x1875574819669120:12345-192.168.204.26@tcp:101:chmod.0 00010000:00010000:3.0:1788687754.524304:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687754.524332:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aaca00/0xc2ddd83e74448e40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.524417:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.524433:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.524445:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687754.524547:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788687754.524551:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687754.524594:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.524623:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aaca00/0xc2ddd83e74448e40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b04 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.524643:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b04 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.524652:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c800) 00010000:00010000:3.0:1788687754.524655:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788687754.524659:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac800, rc 0) 00000100:00100000:3.0:1788687754.524920:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee47ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:9685:x1875574819669120:12345-192.168.204.26@tcp:101:chmod.0 Request processed in 640us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687754.524928:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:1.0:1788687754.527691:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.528055:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819669376 00000100:00100000:3.0:1788687754.528067:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819669376 00000100:00100000:3.0:1788687754.528131:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:3.0:1788687754.528142:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:9685:x1875574819669376:12345-192.168.204.26@tcp:36:chmod.0 00010000:00010000:3.0:1788687754.528196:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687754.528327:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b04 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.528348:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c800) 00010000:00010000:3.0:1788687754.528373:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687754.528402:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.528414:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.528425:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788687754.529176:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009758fdeb reply state 000000003bbf4e8d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687754.529189:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788687754.529198:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788687754.529408:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:9685:x1875574819669376:12345-192.168.204.26@tcp:36:chmod.0 Request processed in 1266us (1725us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788687754.529417:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00010000:00010000:1.0:1788687754.535807:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.535828:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.535836:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.535841:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aacc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687754.535847:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.535855:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.535875:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:1.0:1788687754.535878:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788687754.535883:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.535889:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74448e4e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687754.560609:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.560863:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819669504 00000100:00100000:3.0:1788687754.560874:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819669504 00000100:00100000:3.0:1788687754.560947:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:3.0:1788687754.560958:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:9686:x1875574819669504:12345-192.168.204.26@tcp:101:chown.0 00010000:00010000:3.0:1788687754.561000:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687754.561028:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b0b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.561112:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aaca00/0xc2ddd83e74448e5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.561126:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aaca00/0xc2ddd83e74448e5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.561152:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aaca00/0xc2ddd83e74448e5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687754.561194:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788687754.561199:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687754.561247:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aaca00/0xc2ddd83e74448e5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.561277:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b0b expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.561296:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aaca00/0xc2ddd83e74448e5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b0b expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.561304:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c800) 00010000:00010000:3.0:1788687754.561307:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788687754.561310:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aaca00, rc 0) 00000100:00100000:3.0:1788687754.561376:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:9686:x1875574819669504:12345-192.168.204.26@tcp:101:chown.0 Request processed in 420us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687754.561383:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:0.0:1788687754.566870:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687754.567040:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819669632 00000100:00100000:2.0:1788687754.567050:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819669632 00000100:00100000:2.0:1788687754.567118:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:2.0:1788687754.567129:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:9686:x1875574819669632:12345-192.168.204.26@tcp:101:chown.0 00010000:00010000:2.0:1788687754.567151:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687754.567174:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9000/0xc2ddd83e74448e63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b12 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567251:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448e6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567266:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567278:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567294:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448e71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567301:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567307:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567427:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448e78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567436:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567442:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687754.567477:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788687754.567533:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687754.567558:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567571:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567577:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448e6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567584:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448e6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567589:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687754.567593:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448e6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567601:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448e6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567613:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c800) 00010000:00010000:2.0:1788687754.567773:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687754.567779:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448e6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567785:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567799:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567805:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448e71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567810:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448e71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567815:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687754.567818:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448e71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567824:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448e71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567832:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9af3e29fee00) 00010000:00010000:2.0:1788687754.567834:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687754.567836:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448e71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567842:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448e71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567877:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9000/0xc2ddd83e74448e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b12 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567904:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b12 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.567913:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3e29fe200) 00010000:00010000:2.0:1788687754.567915:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687754.567917:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d8600, rc 0) 00000100:00100000:2.0:1788687754.567986:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:9686:x1875574819669632:12345-192.168.204.26@tcp:101:chown.0 Request processed in 859us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687754.567994:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:0.0:1788687754.581851:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.581983:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819669888 00000100:00100000:3.0:1788687754.581999:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819669888 00000100:00100000:3.0:1788687754.582115:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:3.0:1788687754.582130:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:9686:x1875574819669888:12345-192.168.204.26@tcp:36:chown.0 00010000:00010000:3.0:1788687754.582434:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687754.582667:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448e78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b12 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.582746:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3e29fe200) 00010000:00010000:3.0:1788687754.582772:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687754.582822:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.582843:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.582858:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788687754.664705:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1788687754.664739:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788687754.665006:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b583256 reply state 00000000340b81ad transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687754.665022:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788687754.665042:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788687754.665176:0:5841:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788687754.665198:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:9686:x1875574819669888:12345-192.168.204.26@tcp:36:chown.0 Request processed in 83069us (83361us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788687754.665208:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00010000:00010000:2.0:1788687754.667150:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.667187:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.667196:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.667202:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687754.667208:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.667218:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.667238:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:2.0:1788687754.667241:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788687754.667247:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.667269:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74448e7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687754.705150:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.705267:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819670016 00000100:00100000:3.0:1788687754.705278:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819670016 00000100:00100000:3.0:1788687754.705343:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:3.0:1788687754.705355:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:9687:x1875574819670016:12345-192.168.204.26@tcp:101:touch.500 00010000:00010000:3.0:1788687754.705381:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687754.705405:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448e86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b19 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788687754.710751:0:5839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5224us 00010000:00010000:3.0:1788687754.735682:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448e8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.735717:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.735733:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.735749:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448e94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.735757:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.735764:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736129:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad800/0xc2ddd83e74448e9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736285:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad800/0xc2ddd83e74448e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736295:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad800/0xc2ddd83e74448e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687754.736318:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788687754.736322:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687754.736368:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad800/0xc2ddd83e74448e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736381:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736388:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448e8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736396:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448e8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736402:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687754.736406:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448e8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736414:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448e8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736426:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c800) 00010000:00010000:3.0:1788687754.736429:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687754.736433:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448e8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736440:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736451:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736456:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448e94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736473:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448e94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736495:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687754.736498:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448e94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736505:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448e94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736512:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9af3ca87c600) 00010000:00010000:3.0:1788687754.736515:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687754.736518:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448e94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736523:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448e94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736565:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448e86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b19 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736581:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad800/0xc2ddd83e74448e9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b19 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.736588:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3ca87c700) 00010000:00010000:3.0:1788687754.736591:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788687754.736593:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad800, rc 0) 00000100:00100000:3.0:1788687754.736665:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:9687:x1875574819670016:12345-192.168.204.26@tcp:101:touch.500 Request processed in 31312us (31527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687754.736682:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:1.0:1788687754.747271:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687754.747342:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819670272 00000100:00100000:2.0:1788687754.747353:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819670272 00000100:00100000:2.0:1788687754.747422:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:2.0:1788687754.747434:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:9687:x1875574819670272:12345-192.168.204.26@tcp:101:touch.500 00010000:00010000:2.0:1788687754.747458:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687754.747521:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9000/0xc2ddd83e74448ea2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b20 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.747819:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448ea9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.747835:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448ea9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.747848:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448ea9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.747924:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.747933:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.747941:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788687754.748697:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788687754.748970:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448eb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.748983:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.748992:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.749028:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448ea9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.749035:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448ea9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.749042:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448ea9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.749049:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687754.749054:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448ea9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.749062:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448ea9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.749074:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3ca87c700) 00010000:00010000:2.0:1788687754.749077:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687754.749082:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448ea9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.749098:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9c00/0xc2ddd83e74448ea9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788687754.749112:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f839b4d reply state 00000000c0c91319 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687754.749121:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788687754.749153:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9000/0xc2ddd83e74448ea2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b20 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.749167:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b20 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.749175:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9af3e29fee00) 00010000:00010000:2.0:1788687754.749177:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687754.749180:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4021d8600, rc 0) 00000100:00100000:2.0:1788687754.749249:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:9687:x1875574819670272:12345-192.168.204.26@tcp:101:touch.500 Request processed in 1817us (1988us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788687754.749257:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00010000:00010000:2.0:1788687754.754110:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.754128:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.754137:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.754144:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687754.754164:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.754173:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.754191:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9af3e29fe300) 00010000:00010000:2.0:1788687754.754194:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687754.754199:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.754216:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d9800/0xc2ddd83e74448eb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.757766:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687754.759163:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687754.759247:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819670528 00000100:00100000:2.0:1788687754.759258:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819670528 00000100:00100000:2.0:1788687754.759329:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:2.0:1788687754.759340:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:9687:x1875574819670528:12345-192.168.204.26@tcp:36:touch.500 00010000:00010000:2.0:1788687754.759404:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687754.759435:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af4021d8600/0xc2ddd83e74448eb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b20 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.759456:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9af3e29fee00) 00010000:00010000:2.0:1788687754.759469:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788687754.759563:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.759578:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.759589:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788687754.760175:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006324949d reply state 00000000f32997b3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687754.760187:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788687754.760348:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:9687:x1875574819670528:12345-192.168.204.26@tcp:36:touch.500 Request processed in 1008us (1193us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788687754.760356:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:1.0:1788687754.772080:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687754.772194:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819670656 00000100:00100000:0.0:1788687754.772206:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819670656 00000100:00100000:0.0:1788687754.772270:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:0.0:1788687754.772280:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:9687:x1875574819670656:12345-192.168.204.26@tcp:101:touch.500 00010000:00010000:0.0:1788687754.772314:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687754.772339:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448ecc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.772405:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448ecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b27 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.772422:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448ecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b27 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.772443:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9af3e29fec00) 00010000:00010000:0.0:1788687754.772446:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788687754.772449:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec000, rc 0) 00010000:00010000:3.0:1788687754.772514:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.772526:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687754.772528:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:9687:x1875574819670656:12345-192.168.204.26@tcp:101:touch.500 Request processed in 249us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687754.772550:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00010000:00010000:3.0:1788687754.772821:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.772828:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687754.772834:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.772843:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.772857:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9af3e29fec00) 00010000:00010000:3.0:1788687754.772860:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687754.772863:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.772880:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3400/0xc2ddd83e74448ec5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687754.785999:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687754.787565:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819670784 00000100:00100000:1.0:1788687754.787583:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819670784 00000100:00100000:1.0:1788687754.787657:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:1.0:1788687754.787666:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875574819670784:12345-192.168.204.26@tcp:8:touch.500 00010000:00080000:1.0:1788687754.787713:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:1.0:1788687754.787751:0:6686:0:(genops.c:1385:class_connect()) connect: client bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f, cookie 0xc2ddd83e74448ed3 00002000:00100000:1.0:1788687754.787766:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f/ffff9af3f79c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788687754.789151:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788687754.789430:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788687754.789503:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9af3f79ce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687754.789595:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2345:x1875574819670784:12345-192.168.204.26@tcp:8:touch.500 Request processed in 1927us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687754.789607:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:1.0:1788687754.804471:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687754.804768:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819670912 00000100:00100000:2.0:1788687754.804780:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819670912 00000100:00100000:2.0:1788687754.804923:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:2.0:1788687754.804935:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:0:x1875574819670912:12345-192.168.204.26@tcp:2:touch.500 00000100:00080000:0.0:1788687754.807796:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788687754.844452:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000001:00080000:3.0:1788687754.844473:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1788687754.844895:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:0:x1875574819670912:12345-192.168.204.26@tcp:2:touch.500 Request processed in 39956us (40429us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788687754.844908:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:0.0:1788687754.858554:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687754.859408:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819671168 00000100:00100000:1.0:1788687754.859421:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819671168 00000100:00100000:1.0:1788687754.859519:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:1.0:1788687754.859529:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:9687:x1875574819671168:12345-192.168.204.26@tcp:35:touch.500 00000100:00100000:1.0:1788687754.859906:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:9687:x1875574819671168:12345-192.168.204.26@tcp:35:touch.500 Request processed in 378us (1362us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788687754.859915:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:3.0:1788687754.893792:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687754.893926:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819671296 00000100:00100000:2.0:1788687754.893940:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819671296 00000100:00100000:2.0:1788687754.894013:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:2.0:1788687754.894026:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:9688:x1875574819671296:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:2.0:1788687754.894055:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687754.894080:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74448eda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.894298:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74448ee1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.894314:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74448ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.894343:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74448ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687754.894380:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788687754.894384:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687754.894422:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74448ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.895078:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74448eda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b2e expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.895181:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74448ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b2e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687754.895191:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3ca87c700) 00010000:00010000:2.0:1788687754.895194:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687754.895271:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2200, rc 0) 00000100:00100000:3.0:1788687754.895498:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:9688:x1875574819671296:12345-192.168.204.26@tcp:101:rm.0 Request processed in 1456us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687754.895518:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:0.0:1788687754.899342:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.899614:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819671552 00000100:00100000:3.0:1788687754.899626:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819671552 00000100:00100000:1.0:1788687754.899735:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:1.0:1788687754.899749:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:9688:x1875574819671552:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:1.0:1788687754.899772:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687754.899811:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74448ee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b35 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687754.899904:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788687754.900068:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74448ee8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b35 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.900098:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c800) 00010000:00010000:1.0:1788687754.900102:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788687754.900107:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74448ee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b35 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.900121:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd400, rc 0) 00000100:00100000:1.0:1788687754.900185:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:9688:x1875574819671552:12345-192.168.204.26@tcp:101:rm.0 Request processed in 440us (857us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788687754.900194:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:0.0:1788687754.910042:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687754.910964:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819671680 00000100:00100000:1.0:1788687754.910978:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819671680 00000100:00100000:1.0:1788687754.911096:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:1.0:1788687754.911108:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:9688:x1875574819671680:12345-192.168.204.26@tcp:37:rm.0 00000100:00100000:1.0:1788687754.919103:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:9688:x1875574819671680:12345-192.168.204.26@tcp:37:rm.0 Request processed in 7985us (9058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687754.919118:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:0.0:1788687754.924418:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.924505:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819671936 00000100:00100000:3.0:1788687754.924515:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819671936 00000100:00100000:3.0:1788687754.924569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788687754.924578:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b97850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:9688:x1875574819671936:12345-192.168.204.26@tcp:35:rm.0 00000100:00100000:3.0:1788687754.924812:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b97850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:9688:x1875574819671936:12345-192.168.204.26@tcp:35:rm.0 Request processed in 234us (402us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788687754.924820:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:2.0:1788687754.931285:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.931428:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819672192 00000100:00100000:3.0:1788687754.931440:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819672192 00000100:00100000:3.0:1788687754.931603:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:3.0:1788687754.931615:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:9688:x1875574819672192:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:3.0:1788687754.931640:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687754.931663:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448ef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b3c expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.931777:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448efd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.931791:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448efd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.931804:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448efd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687754.931815:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788687754.931986:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448ef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b3c expref: 17 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.932004:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448efd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b3c expref: 16 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.932013:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3ca87c700) 00010000:00010000:3.0:1788687754.932016:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788687754.932019:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aade00, rc 0) 00000100:00100000:3.0:1788687754.932098:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:9688:x1875574819672192:12345-192.168.204.26@tcp:101:rm.0 Request processed in 484us (823us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788687754.932105:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:2.0:1788687754.939629:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.940561:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819672320 00000100:00100000:3.0:1788687754.940575:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819672320 00000100:00100000:3.0:1788687754.940648:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:3.0:1788687754.940660:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:9688:x1875574819672320:12345-192.168.204.26@tcp:41:rm.0 00000004:00000024:3.0:1788687754.940734:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788687754.940819:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:9688:x1875574819672320:12345-192.168.204.26@tcp:41:rm.0 Request processed in 161us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687754.940828:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:1.0:1788687754.943646:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687754.943776:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819672448 00000100:00100000:0.0:1788687754.943786:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819672448 00000100:00100000:0.0:1788687754.943846:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:0.0:1788687754.943858:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:9688:x1875574819672448:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:0.0:1788687754.943878:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687754.943901:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448f0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b43 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.943979:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448f12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.943996:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448f12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944007:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448f12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944023:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448f19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944030:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944036:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944440:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448f20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944449:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944457:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687754.944723:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788687754.944728:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687754.944754:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944767:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944776:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448f12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944782:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448f12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944788:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448f12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944796:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687754.944801:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448f12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944809:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448f12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944834:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3ca87c700) 00010000:00010000:0.0:1788687754.944836:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687754.944841:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448f12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944848:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448f12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944863:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944870:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448f19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944876:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944882:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687754.944884:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944890:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448f19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944898:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9af3d2736e00) 00010000:00010000:0.0:1788687754.944901:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687754.944904:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448f19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944910:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448f19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944956:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448f0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b43 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944971:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448f20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b43 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.944978:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9af3e29fec00) 00010000:00010000:0.0:1788687754.944980:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788687754.944983:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec600, rc 0) 00000100:00100000:0.0:1788687754.945114:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:9688:x1875574819672448:12345-192.168.204.26@tcp:101:rm.0 Request processed in 1259us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687754.945123:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:2.0:1788687754.953392:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.953646:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819672704 00000100:00100000:3.0:1788687754.953657:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819672704 00000100:00100000:3.0:1788687754.953731:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:3.0:1788687754.953742:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:9688:x1875574819672704:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:3.0:1788687754.953807:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788687754.953838:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448f20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b43 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.953896:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448ecc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b27 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.953908:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9af3e29fec00) 00010000:00010000:3.0:1788687754.953925:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74448ee1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b2e expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.953934:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3ca87c700) 00010000:00010000:3.0:1788687754.953937:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687754.953959:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.953972:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.954805:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.954825:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.954834:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.954840:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.954995:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.955014:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.955021:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788687754.955863:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788687754.955875:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 300646393587ns, next at 301646391036ns, rc = 0 00010000:00010000:3.0:1788687754.955939:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.955952:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.955960:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.955967:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.955974:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.955981:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.955998:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687754.956022:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956029:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f35 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956047:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956053:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687754.956059:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956068:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f35 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956081:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:3.0:1788687754.956084:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788687754.956088:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f35 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956094:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f35 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956111:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956117:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956122:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956128:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687754.956130:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956147:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956154:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3ca87c700) 00010000:00010000:3.0:1788687754.956156:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687754.956159:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.956165:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788687754.956175:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1db355f reply state 00000000945c8ddd transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687754.956184:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788687754.956294:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:9688:x1875574819672704:12345-192.168.204.26@tcp:36:rm.0 Request processed in 2550us (2910us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788687754.956304:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00010000:00010000:1.0:1788687754.957361:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687754.957375:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.957404:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687754.957409:0:5827:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.957416:0:5827:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.957433:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:1.0:1788687754.957437:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788687754.957441:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.957447:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.957470:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687754.957472:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687754.957474:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687754.961060:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:1.0:1788687754.961297:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.961310:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.961318:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.961325:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687754.961331:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.961362:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.961381:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9af3ca87ca00) 00010000:00010000:1.0:1788687754.961384:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687754.961389:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687754.961397:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74448f2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687754.966713:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819672960 00000100:00100000:3.0:1788687754.966730:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819672960 00000100:00100000:3.0:1788687754.966861:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:3.0:1788687754.966872:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:9688:x1875574819672960:12345-192.168.204.26@tcp:35:rm.0 00000100:00100000:3.0:1788687754.967174:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:9688:x1875574819672960:12345-192.168.204.26@tcp:35:rm.0 Request processed in 303us (6123us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788687754.967183:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:2.0:1788687754.978816:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687754.979374:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819673216 00000100:00100000:3.0:1788687754.979384:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819673216 00000100:00100000:3.0:1788687754.979442:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:3.0:1788687754.979468:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:9688:x1875574819673216:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:3.0:1788687754.979573:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788687754.979611:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74448efd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b3c expref: 16 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.979638:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad800/0xc2ddd83e74448e9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b19 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.979650:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3ca87c700) 00010000:00010000:3.0:1788687754.979667:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aaca00/0xc2ddd83e74448e5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b0b expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.979677:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c800) 00010000:00010000:3.0:1788687754.979684:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687754.979717:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f43 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.979730:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.979740:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.979753:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.979759:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.979765:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.980058:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.980067:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.980074:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687754.982905:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788687754.982934:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.982945:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f51 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.982953:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.982959:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687754.982963:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.982971:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f51 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.983003:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:0.0:1788687754.983006:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788687754.983011:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f51 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.983018:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74448f51 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.983048:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.983054:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f43 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.983060:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.983065:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687754.983067:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.983072:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f43 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.983079:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:0.0:1788687754.983081:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687754.983084:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f43 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687754.983089:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74448f43 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788687754.983113:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000869bc46f reply state 00000000ffb7be32 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687754.983122:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788687754.983750:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:9688:x1875574819673216:12345-192.168.204.26@tcp:36:rm.0 Request processed in 4278us (5272us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788687754.983759:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00010000:00010000:3.0:1788687754.987288:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.987305:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.987313:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.987319:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687754.987324:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.987331:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.987346:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9af3ca87ce00) 00010000:00010000:3.0:1788687754.987349:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687754.987352:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687754.987358:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e74448f4a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687755.782633:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687756.807129:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687757.382829:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839627392:0@lo:400:kworker.0 00000100:00100000:2.0:1788687757.382911:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687757.382976:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839627904:0@lo:400:kworker.0 00000100:00100000:0.0:1788687757.383135:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839627520:0@lo:400:kworker.0 00000100:00100000:0.0:1788687757.383167:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687757.383227:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839627648:0@lo:400:kworker.0 00000100:00100000:1.0:1788687757.383404:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839627392 00000100:00100000:1.0:1788687757.383414:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839627392 00000100:00100000:1.0:1788687757.383467:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788687757.383478:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839627392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687757.384021:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839628032:0@lo:400:kworker.0 00000100:00100000:0.0:1788687757.384057:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687757.384099:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839628032 00000100:00100000:0.0:1788687757.384104:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839628032 00000100:00100000:3.0:1788687757.384134:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687757.384160:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788687757.384169:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839628032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687757.384234:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839628160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788687757.384668:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687757.384752:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687757.384762:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839628032:12345-0@lo:400:kworker.0 Request processed in 592us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687757.384772:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788687757.384794:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1788687757.384802:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788687757.384804:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839627776:0@lo:400:kworker.0 00000100:00100000:0.0:1788687757.384815:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839627520 00000100:00100000:0.0:1788687757.384820:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839627520 00000100:00100000:3.0:1788687757.384845:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687757.384851:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839627648 00000100:00100000:0.0:1788687757.384856:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839627648 00000100:00100000:0.0:1788687757.384880:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839627904 00000100:00100000:0.0:1788687757.384884:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839627904 00000100:00100000:3.0:1788687757.384892:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788687757.384904:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839627520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687757.384908:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788687757.384932:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839627648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687757.384947:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839627520:12345-0@lo:400:kworker.0 Request processed in 46us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687757.384955:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788687757.384972:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788687757.384985:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839627904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687757.384986:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839627648:12345-0@lo:400:kworker.0 Request processed in 52us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687757.384997:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788687757.385022:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839627904:12345-0@lo:400:kworker.0 Request processed in 43us (364us total) trans 0 rc 0/0 00000100:00080000:0.0:1788687757.385022:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687757.385032:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788687757.385056:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839627776 00000100:00100000:0.0:1788687757.385060:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839627520:0@lo:400:kworker.0 00000100:00100000:3.0:1788687757.385061:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839627776 00010000:00080000:0.0:1788687757.385081:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c2e84e00 x1875574839628032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687757.385092:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839628032:0@lo:400:kworker.0 00000100:00100000:3.0:1788687757.385102:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788687757.385109:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839627776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687757.385139:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839627776:12345-0@lo:400:kworker.0 Request processed in 31us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687757.385145:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788687757.385191:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839628160 00000100:00100000:3.0:1788687757.385195:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839628160 00000100:00100000:3.0:1788687757.385225:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788687757.385231:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839628160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788687757.385263:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687757.385298:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839628160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687757.385304:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788687757.385323:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788687757.385354:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c2e86a00 x1875574839627776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687757.385365:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839627776:0@lo:400:kworker.0 00000100:00100000:3.0:1788687757.385377:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839627648:0@lo:400:kworker.0 00010000:00080000:3.0:1788687757.385391:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82da300 x1875574839628160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687757.385408:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839628160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687757.385457:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839627392:12345-0@lo:400:kworker.0 Request processed in 1979us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687757.385466:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788687757.385742:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839627904:0@lo:400:kworker.0 00000100:00100000:2.0:1788687757.385772:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839627392:0@lo:400:kworker.0 00010000:00010000:0.0:1788687757.832542:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788687757.894025:0:8141:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303584540996ns, next at 304584537893ns, rc = 0 00000100:00100000:3.0:1788687757.894144:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839628288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687757.894221:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687757.894522:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839628288 00000100:00100000:0.0:1788687757.894531:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839628288 00000100:00100000:0.0:1788687757.894631:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788687757.894641:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839628288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788687757.894697:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687757.894757:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839628288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687757.894764:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788687757.894806:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3f40b9880 x1875574839628288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687757.894824:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839628288:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788687758.854284:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788687759.077792:0:11619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1788687759.340122:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687759.340201:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687759.340234:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687759.340265:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819673472 00000100:00100000:2.0:1788687759.340270:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687759.340276:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819673472 00000100:00100000:0.0:1788687759.340355:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819673728 00000100:00080000:2.0:1788687759.340367:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687759.340372:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819673728 00000100:00080000:2.0:1788687759.340407:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687759.340414:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 102 00000100:00100000:0.0:1788687759.340424:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:2348:x1875574819673472:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687759.340458:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819673600 00000100:00100000:3.0:1788687759.340465:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819673600 00000100:00100000:0.0:1788687759.340532:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:2348:x1875574819673472:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 110us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687759.340541:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 102 00000100:00100000:0.0:1788687759.340561:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:3.0:1788687759.340566:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:0.0:1788687759.340571:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2348:x1875574819673728:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687759.340580:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819673600:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687759.340600:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2348:x1875574819673728:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687759.340607:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:1.0:1788687759.340871:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819673344 00000100:00100000:1.0:1788687759.340876:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819673344 00000100:00100000:1.0:1788687759.340899:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 249 00000100:00100000:1.0:1788687759.340905:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2348:x1875574819673344:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687759.340937:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2348:x1875574819673344:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 33us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687759.340944:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 249 00000100:00100000:3.0:1788687759.342801:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819673600:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687759.342815:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00080000:2.0:1788687759.344132:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788687759.880621:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788687760.012511:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788687760.012540:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:2.0:1788687760.012556:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788687760.012563:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788687760.012878:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839628416:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788687760.012949:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687760.013028:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839628416 00000100:00100000:2.0:1788687760.013036:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839628416 00000100:00100000:2.0:1788687760.013097:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788687760.013434:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839628416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788687760.013465:0:8309:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00080000:0.0:1788687760.013533:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788687760.014241:0:8309:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9d358a, atime: 0x6a9d358a, ctime: 0x6a9d358a, blocks: 0x1 00010000:00010000:2.0:1788687760.014254:0:8309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fabf014b/0xc2ddd83e74448f58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.014273:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=305s v=(0 0) 00010000:00010000:2.0:1788687760.014277:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687760.014284:0:8309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fabf014b/0xc2ddd83e74448f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.014323:0:8309:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fabf014b/0xc2ddd83e74448f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.014336:0:8309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fabf014b/0xc2ddd83e74448f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.014343:0:8309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fabf014b/0xc2ddd83e74448f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.014369:0:8309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788687760.015009:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839628416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1901us (2056us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788687760.015018:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788687760.015622:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3c2e86a00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788687760.015631:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839628416:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788687760.015785:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687760.015795:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fabf014b/0xc2ddd83e74448f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687760.015806:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3c00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687760.015817:0:5827:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fabf014b/0xc2ddd83e74448f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687760.015829:0:5827:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fabf014b/0xc2ddd83e74448f58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687760.015851:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fabf014b/0xc2ddd83e74448f58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687760.015859:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fabf014b/0xc2ddd83e74448f58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687760.015896:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687760.015898:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687760.015899:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788687760.362201:0:11669:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcad1ce0d0 20000000:00000080:2.0:1788687760.362218:0:11669:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af3f7954c00 uarg=0000000000000000 20000000:01000000:2.0:1788687760.362254:0:11669:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788687760.362262:0:11669:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788687760.362267:0:11669:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788687760.363773:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788687760.363939:0:11669:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788687760.374576:0:11669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788687760.375737:0:11669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788687760.375814:0:11669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788687760.375835:0:11669:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788687760.375862:0:11669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.375900:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74448dfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462af6 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.375908:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448e01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462afd expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.375917:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4021d8a00/0xc2ddd83e74448e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448e08 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.375923:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3f38cde00/0xc2ddd83e74448e1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448e16 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.375929:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74448e2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448e24 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.375936:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.376015:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74448e2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448e24 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.379201:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74448e2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448e24 expref: 18 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687760.379258:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1875574839628544:0@lo:104: 00000100:00100000:1.0:1788687760.379349:0:11669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788687760.379453:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3f38cde00/0xc2ddd83e74448e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448e16 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.379465:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af3f38cde00/0xc2ddd83e74448e1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448e16 expref: 18 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687760.379475:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1875574839628672:0@lo:104: 00000100:00100000:1.0:1788687760.379521:0:11669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788687760.379555:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4021d8a00/0xc2ddd83e74448e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74448e08 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.379564:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4021d8a00/0xc2ddd83e74448e0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74448e08 expref: 18 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687760.379573:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1875574839628800:0@lo:104: 00000100:00100000:1.0:1788687760.379613:0:11669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788687760.379636:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462afd expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.379648:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448e01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462afd expref: 12 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687760.379658:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1875574839628928:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687760.379732:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74448dfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462af6 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687760.379750:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74448dfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462af6 expref: 12 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687760.379760:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1875574839629056:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687760.379785:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c3cfacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687760.380884:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788687760.380904:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839628544 00000100:00100000:0.0:1788687760.380912:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839628544 00000100:00100000:0.0:1788687760.380951:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839628672 00000100:00100000:0.0:1788687760.380954:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839628672 00000100:00100000:0.0:1788687760.380963:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839628800 00000100:00100000:0.0:1788687760.380965:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839628800 00000100:00100000:0.0:1788687760.380977:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788687760.380986:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:11669:x1875574839628544:12345-0@lo:104: 00010000:00010000:0.0:1788687760.381003:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381110:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788687760.381116:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+5:11669:x1875574839628544:12345-0@lo:104: Request processed in 132us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687760.381123:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788687760.381141:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788687760.381147:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:11669:x1875574839628672:12345-0@lo:104: 00010000:00010000:0.0:1788687760.381154:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381184:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788687760.381189:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+4:11669:x1875574839628672:12345-0@lo:104: Request processed in 44us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687760.381195:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788687760.381207:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788687760.381213:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:11669:x1875574839628800:12345-0@lo:104: 00010000:00010000:0.0:1788687760.381220:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381245:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788687760.381250:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+3:11669:x1875574839628800:12345-0@lo:104: Request processed in 38us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687760.381255:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788687760.381289:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788687760.381294:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381311:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed800 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687760.381315:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381324:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687760.381331:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687760.381337:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788687760.381378:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381385:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788687760.381407:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381414:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed800/0xc2ddd83e74448e24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448e2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381429:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788687760.381432:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381438:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd000 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687760.381441:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381459:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687760.381465:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687760.381469:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788687760.381518:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381524:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788687760.381539:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381546:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd000/0xc2ddd83e74448e16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448e1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381555:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687760.381557:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381562:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec800 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687760.381565:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381571:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687760.381577:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687760.381588:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788687760.381612:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381618:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788687760.381625:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381631:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3f79ec800/0xc2ddd83e74448e08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74448e0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381645:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687760.381646:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687760.381648:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687760.381663:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f40b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839629184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687760.381695:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687760.381739:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839629440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687760.381760:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687760.381779:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788687760.381784:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839629312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687760.381807:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687760.381831:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839629184 00000100:00100000:0.0:1788687760.381835:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839629184 00010000:00010000:0.0:1788687760.381854:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74448e2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448e24 expref: 19 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687760.381875:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839629440 00000100:00100000:0.0:1788687760.381878:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839629440 00010000:00010000:0.0:1788687760.381899:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4021d8a00/0xc2ddd83e74448e0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448e08 expref: 20 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687760.381911:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839629312 00000100:00100000:0.0:1788687760.381914:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839629312 00010000:00010000:0.0:1788687760.381926:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3f38cde00/0xc2ddd83e74448e1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448e16 expref: 21 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687760.381937:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788687760.381944:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+21:3311:x1875574839629184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788687760.381955:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687760.381961:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74448e2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448e24 expref: 21 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381973:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74448e2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448e24 expref: 21 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.381992:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687760.382020:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+21:3311:x1875574839629184:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687760.382027:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788687760.382040:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788687760.382046:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+20:3313:x1875574839629440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788687760.382053:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687760.382057:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4021d8a00/0xc2ddd83e74448e0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448e08 expref: 20 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.382065:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4021d8a00/0xc2ddd83e74448e0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448e08 expref: 20 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.382086:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687760.382112:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+20:3313:x1875574839629440:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687760.382119:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788687760.382131:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788687760.382138:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c690bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839629312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788687760.382145:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687760.382150:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3f38cde00/0xc2ddd83e74448e1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74448e16 expref: 19 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.382167:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3f38cde00/0xc2ddd83e74448e1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74448e16 expref: 19 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.382176:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687760.382198:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c690bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839629312:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687760.382203:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788687760.382256:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f40b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839629184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687760.382281:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839629312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687760.382288:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839629440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687760.382813:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687760.383002:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74448e2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448e24 expref: 18 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687760.383029:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1875574839628544:0@lo:104: 00010000:00010000:2.0:1788687760.383041:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38cde00/0xc2ddd83e74448e1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448e16 expref: 17 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687760.383064:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1875574839628672:0@lo:104: 00010000:00010000:2.0:1788687760.383077:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d8a00/0xc2ddd83e74448e0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74448e08 expref: 16 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687760.383085:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1875574839628800:0@lo:104: 00000100:00100000:0.0:1788687760.383978:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687760.384109:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687760.384192:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1875574839628928:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687760.384203:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1875574839629056:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687760.384236:0:11669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687760.384930:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819673856 00000100:00100000:1.0:1788687760.384940:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819673856 00010000:00010000:1.0:1788687760.384987:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448e01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462afd expref: 13 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687760.385167:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819673984 00000100:00100000:1.0:1788687760.385172:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819673984 00010000:00010000:1.0:1788687760.385190:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74448dfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462af6 expref: 14 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687760.385232:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:2.0:1788687760.385244:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+14:2347:x1875574819673856:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687760.385259:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687760.385266:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448e01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462afd expref: 14 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385277:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462afd expref: 14 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385297:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d8200/0xc2ddd83e74448e01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462afd expref: 14 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385318:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687760.385385:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819673856:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 142us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687760.385392:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:2.0:1788687760.385423:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:2.0:1788687760.385429:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:2347:x1875574819673984:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687760.385437:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687760.385441:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74448dfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462af6 expref: 12 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385450:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74448dfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462af6 expref: 12 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385461:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74448dfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462af6 expref: 12 pid: 5831 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385472:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385502:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385517:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385524:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385530:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385537:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385544:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687760.385552:0:5824:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385562:0:5824:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385577:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687760.385590:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687760.385622:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:2347:x1875574819673984:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 193us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687760.385629:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00010000:00010000:3.0:1788687760.385704:0:11669:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687760.385723:0:11669:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687760.385729:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38cce00/0xc2ddd83e74448f5f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687760.901692:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687761.926044:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788687762.245749:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788687762.245759:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3ffb81000 from 7 10000000:01000000:3.0:1788687762.245764:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788687762.245817:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687762.245829:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687762.245841:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687762.245867:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839629568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.245942:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687762.246016:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788687762.246117:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839629568 00000100:00100000:1.0:1788687762.246125:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839629568 00000100:00100000:1.0:1788687762.246183:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788687762.246192:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:5836:x1875574839629568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687762.246207:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687762.246220:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cd200/0xc2ddd83e74448f6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448f66 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687762.246247:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cd200/0xc2ddd83e74448f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448f66 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687762.246258:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cd200/0xc2ddd83e74448f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448f66 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687762.246287:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd200, rc 0) 00000100:00100000:1.0:1788687762.246337:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839629568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687762.246344:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788687762.246513:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839629568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788687762.246528:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687762.246538:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687762.246601:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839629696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.246624:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687762.246649:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788687762.246695:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839629696 00000100:00100000:0.0:1788687762.246700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839629696 00000100:00100000:0.0:1788687762.246731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788687762.246737:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839629696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687762.246968:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839629696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687762.246976:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788687762.247110:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839629696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.247147:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839629824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.247185:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687762.247206:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788687762.247254:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839629824 00000100:00100000:0.0:1788687762.247258:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839629824 00000100:00100000:0.0:1788687762.247291:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788687762.247297:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839629824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687762.247446:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839629824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687762.247452:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788687762.247774:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839629824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.248298:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11682:1875574839629952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687762.248350:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687762.248384:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788687762.248675:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839629952 00000100:00100000:2.0:1788687762.248681:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839629952 00000100:00100000:2.0:1788687762.248715:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788687762.248723:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:11682:x1875574839629952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687762.248878:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:11682:x1875574839629952:12345-0@lo:502:llog_process_th.0 Request processed in 155us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687762.248885:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788687762.249549:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11682:1875574839629952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788687762.249587:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687762.249597:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687762.249599:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788687762.249605:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9af3ffb81000 00000020:00000080:3.0:1788687762.249608:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788687762.249696:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11682:1875574839630080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687762.249736:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687762.249766:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788687762.249822:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839630080 00000100:00100000:1.0:1788687762.249826:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839630080 00000100:00100000:1.0:1788687762.249861:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788687762.249869:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:11682:x1875574839630080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788687762.250430:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:11682:x1875574839630080:12345-0@lo:502:llog_process_th.0 Request processed in 560us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687762.250439:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788687762.255354:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11682:1875574839630080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788687762.255402:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687762.255411:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687762.255413:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788687762.255418:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788687762.257036:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788687762.257065:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788687762.257085:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687762.257099:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687762.257110:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788687762.257120:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3f39f5000 from 7 10000000:01000000:2.0:1788687762.257123:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788687762.257163:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687762.257171:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687762.257183:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687762.257210:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839630208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788687762.257279:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.257504:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c68e39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687762.257582:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839630208 00000100:00100000:1.0:1788687762.257589:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839630208 00000100:00100000:1.0:1788687762.257638:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788687762.257647:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:5836:x1875574839630208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687762.257659:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687762.257671:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cc800/0xc2ddd83e74448f7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448f74 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687762.257695:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cc800/0xc2ddd83e74448f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448f74 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687762.257706:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cc800/0xc2ddd83e74448f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448f74 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687762.257714:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc800, rc 0) 00000100:00100000:1.0:1788687762.257763:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839630208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687762.257770:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788687762.261338:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839630208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788687762.261372:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687762.261395:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687762.261493:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839630336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.261555:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687762.261605:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788687762.261711:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839630336 00000100:00100000:0.0:1788687762.261718:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839630336 00000100:00100000:0.0:1788687762.261768:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788687762.261777:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839630336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687762.262056:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839630336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687762.262064:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788687762.262330:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839630336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.262364:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839630464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.262405:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687762.262428:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788687762.262552:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839630464 00000100:00100000:0.0:1788687762.262557:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839630464 00000100:00100000:0.0:1788687762.262596:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788687762.262603:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839630464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687762.262738:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839630464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687762.262745:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788687762.262831:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839630464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788687762.263666:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11685:1875574839630592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687762.263715:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.263745:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6f9e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687762.263790:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839630592 00000100:00100000:3.0:1788687762.263795:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839630592 00000100:00100000:3.0:1788687762.263830:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788687762.263838:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:11685:x1875574839630592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687762.264241:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:11685:x1875574839630592:12345-0@lo:502:llog_process_th.0 Request processed in 403us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687762.264250:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788687762.264449:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11685:1875574839630592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788687762.264475:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788687762.264510:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687762.264513:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788687762.264520:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9af3f39f5000 00000020:00000080:2.0:1788687762.264523:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788687762.264601:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11685:1875574839630720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687762.264637:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.264653:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6f9e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687762.265423:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839630720 00000100:00100000:3.0:1788687762.265431:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839630720 00000100:00100000:3.0:1788687762.265498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788687762.265507:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:11685:x1875574839630720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687762.265700:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:11685:x1875574839630720:12345-0@lo:502:llog_process_th.0 Request processed in 194us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687762.265716:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788687762.265767:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11685:1875574839630720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788687762.265791:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687762.265798:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687762.265800:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788687762.265804:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788687762.265863:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788687762.265879:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788687762.265889:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687762.265901:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687762.268373:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788687762.268377:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3e6e77800 from 7 10000000:01000000:3.0:1788687762.268381:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788687762.268424:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687762.268436:0:5836:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687762.268448:0:5836:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687762.268474:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839630848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.268625:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687762.268673:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687762.269808:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839630848 00000100:00100000:0.0:1788687762.269818:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839630848 00000100:00100000:0.0:1788687762.269870:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788687762.269881:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:5836:x1875574839630848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788687762.269895:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687762.269909:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f79ec800/0xc2ddd83e74448f89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74448f82 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687762.269936:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f79ec800/0xc2ddd83e74448f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74448f82 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687762.269947:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f79ec800/0xc2ddd83e74448f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74448f82 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687762.269956:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec800, rc 0) 00000100:00100000:0.0:1788687762.270025:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839630848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687762.270032:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788687762.270328:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839630848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687762.270347:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687762.270370:0:5836:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687762.270440:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839630976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687762.270472:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.270708:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6f9e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788687762.270739:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839630976 00000100:00100000:2.0:1788687762.270745:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839630976 00000100:00100000:2.0:1788687762.270781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788687762.270790:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839630976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687762.271079:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839630976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687762.271087:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788687762.271124:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839630976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687762.271155:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839631104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788687762.271195:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.271219:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6f9e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788687762.271272:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839631104 00000100:00100000:0.0:1788687762.271277:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839631104 00000100:00100000:0.0:1788687762.271376:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788687762.271385:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839631104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788687762.271614:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:5836:x1875574839631104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687762.271622:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788687762.271784:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:5836:1875574839631104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.274222:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11686:1875574839631232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687762.274368:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687762.274445:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788687762.274947:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839631232 00000100:00100000:0.0:1788687762.274956:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839631232 00000100:00100000:0.0:1788687762.274998:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788687762.275007:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:11686:x1875574839631232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788687762.275262:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:11686:x1875574839631232:12345-0@lo:502:llog_process_th.0 Request processed in 255us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687762.275270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788687762.275300:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11686:1875574839631232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788687762.275332:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788687762.275341:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687762.275344:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788687762.275351:0:11686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9af3e6e77800 00000020:00000080:2.0:1788687762.275353:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788687762.275446:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11686:1875574839631360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687762.275532:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.275572:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839631360 00000100:00100000:2.0:1788687762.275578:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839631360 00000100:00100000:2.0:1788687762.275603:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788687762.275611:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:11686:x1875574839631360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687762.275752:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:11686:x1875574839631360:12345-0@lo:502:llog_process_th.0 Request processed in 140us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687762.275759:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788687762.275803:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6f9e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788687762.275817:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:11686:1875574839631360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788687762.275837:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788687762.275843:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687762.275844:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788687762.275848:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788687762.275925:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788687762.275943:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788687762.275956:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687762.275969:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687762.285182:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000040:00080000:0.0:1788687762.285513:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788687762.289204:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819674112 00000100:00100000:3.0:1788687762.289221:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819674112 00000100:00100000:3.0:1788687762.289289:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 265 00000100:00100000:3.0:1788687762.289301:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:5586:x1875574819674112:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788687762.289319:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687762.289339:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448f90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b4a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687762.289369:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b4a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687762.289380:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b4a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687762.289390:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad800, rc 0) 00000100:00100000:3.0:1788687762.289461:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819674112:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 162us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687762.289468:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 265 00000100:00100000:0.0:1788687762.292914:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687762.292991:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819674240 00000100:00100000:2.0:1788687762.293000:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819674240 00000100:00100000:2.0:1788687762.293050:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 266 00000100:00100000:2.0:1788687762.293070:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819674240:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687762.293517:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819674240:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 457us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687762.293533:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 266 00000100:00100000:0.0:1788687762.299676:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687762.299772:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819674368 00000100:00100000:3.0:1788687762.299783:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819674368 00000100:00100000:3.0:1788687762.299847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 267 00000100:00100000:3.0:1788687762.299858:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819674368:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687762.300115:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819674368:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 256us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687762.300134:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 267 00000100:00100000:2.0:1788687762.304844:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687762.305273:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819674496 00000100:00100000:3.0:1788687762.305286:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819674496 00000100:00100000:3.0:1788687762.305345:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 268 00000100:00100000:3.0:1788687762.305358:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:9958:x1875574819674496:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788687762.305696:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:9958:x1875574819674496:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 338us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687762.305706:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 268 00000100:00100000:1.0:1788687762.310718:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687762.312335:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819674624 00000100:00100000:2.0:1788687762.312349:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819674624 00000100:00100000:2.0:1788687762.312411:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 269 00000100:00100000:2.0:1788687762.312423:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:9958:x1875574819674624:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788687762.312698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:9958:x1875574819674624:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 278us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687762.312706:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 269 00000100:00100000:1.0:1788687762.330813:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687762.331231:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819674752 00000100:00100000:2.0:1788687762.331244:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819674752 00000100:00100000:2.0:1788687762.331359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 270 00000100:00100000:2.0:1788687762.331371:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:5586:x1875574819674752:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687762.331387:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687762.331466:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f15d3400/0xc2ddd83e74448f97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b51 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687762.331572:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f15d3400/0xc2ddd83e74448f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b51 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687762.331586:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f15d3400/0xc2ddd83e74448f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b51 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687762.331596:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3400, rc 0) 00000100:00100000:2.0:1788687762.331707:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:5586:x1875574819674752:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 337us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687762.331732:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 270 00000100:00100000:1.0:1788687762.336209:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687762.336378:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819674880 00000100:00100000:2.0:1788687762.336389:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819674880 00000100:00100000:2.0:1788687762.338321:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 271 00000100:00100000:2.0:1788687762.338345:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:5586:x1875574819674880:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687762.338681:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:5586:x1875574819674880:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 345us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687762.338689:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 271 00000100:00100000:0.0:1788687762.342539:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687762.342707:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819675008 00000100:00100000:1.0:1788687762.342718:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819675008 00000100:00100000:1.0:1788687762.342809:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 272 00000100:00100000:1.0:1788687762.342819:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:5586:x1875574819675008:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687762.343063:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:5586:x1875574819675008:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 240us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687762.343078:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 272 00000100:00100000:1.0:1788687762.348017:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687762.348229:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819675136 00000100:00100000:2.0:1788687762.348240:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819675136 00000100:00100000:2.0:1788687762.348285:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 273 00000100:00100000:2.0:1788687762.348294:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:9961:x1875574819675136:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788687762.348651:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:9961:x1875574819675136:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 357us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687762.348661:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 273 00000100:00100000:2.0:1788687762.352197:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687762.352380:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819675264 00000100:00100000:1.0:1788687762.352457:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819675264 00000100:00100000:0.0:1788687762.352800:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 274 00000100:00100000:0.0:1788687762.352813:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:9961:x1875574819675264:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788687762.353166:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:9961:x1875574819675264:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 355us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687762.353173:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 274 00000100:00100000:0.0:1788687762.502147:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839631744:0@lo:400:kworker.0 00000100:00100000:2.0:1788687762.502391:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839631488:0@lo:400:kworker.0 00000100:00100000:2.0:1788687762.502455:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.502530:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839632000:0@lo:400:kworker.0 00000100:00100000:2.0:1788687762.502568:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.502599:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788687762.502605:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839631616:0@lo:400:kworker.0 00000100:00100000:2.0:1788687762.502627:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.502646:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839632128:0@lo:400:kworker.0 00000100:00100000:2.0:1788687762.502688:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.502718:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839631872:0@lo:400:kworker.0 00000100:00100000:2.0:1788687762.502740:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.502767:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788687762.502773:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839632256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788687762.502796:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687762.502835:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839632000 00000100:00100000:2.0:1788687762.502843:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839632000 00000100:00100000:2.0:1788687762.502896:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839631616 00000100:00100000:2.0:1788687762.502899:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839631616 00000100:00100000:2.0:1788687762.502919:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788687762.502928:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839632000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687762.503186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788687762.503226:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687762.503238:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839631744 00000100:00100000:0.0:1788687762.503242:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839631744 00000100:00100000:0.0:1788687762.503267:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788687762.503274:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839631616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687762.503329:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839631616:12345-0@lo:400:kworker.0 Request processed in 55us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687762.503336:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788687762.503353:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788687762.503359:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839631744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687762.503388:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839631744:12345-0@lo:400:kworker.0 Request processed in 30us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687762.503402:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788687762.503420:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687762.503449:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839631616:0@lo:400:kworker.0 00000100:00100000:0.0:1788687762.503476:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839631744:0@lo:400:kworker.0 00000100:00100000:3.0:1788687762.504018:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839632128 00000100:00100000:3.0:1788687762.504025:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839632128 00000100:00100000:3.0:1788687762.504063:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839631872 00000100:00100000:3.0:1788687762.504066:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839631872 00000100:00100000:2.0:1788687762.504297:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839632000:12345-0@lo:400:kworker.0 Request processed in 1369us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687762.504305:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788687762.504412:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788687762.504425:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839632128:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788687762.504464:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788687762.504470:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788687762.504475:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839632128:12345-0@lo:400:kworker.0 Request processed in 52us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687762.504503:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788687762.504517:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788687762.504526:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839631872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687762.504609:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839632128:0@lo:400:kworker.0 00000100:00100000:0.0:1788687762.504620:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839632000:0@lo:400:kworker.0 00000100:00100000:3.0:1788687762.505093:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839631872:12345-0@lo:400:kworker.0 Request processed in 568us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687762.505101:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788687762.505635:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839631488 00000100:00100000:2.0:1788687762.505642:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839631488 00000100:00100000:2.0:1788687762.505676:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788687762.505683:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839631488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687762.505739:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839632256 00000100:00100000:1.0:1788687762.505745:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839632256 00000100:00100000:1.0:1788687762.505779:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788687762.505787:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839632256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788687762.505818:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687762.505873:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839632256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687762.505879:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788687762.505950:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82dbb80 x1875574839632256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687762.505999:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839632256:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788687762.506014:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c315df80 x1875574839631872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687762.506023:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839631872:0@lo:400:kworker.0 00000100:00100000:2.0:1788687762.506102:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839631488:12345-0@lo:400:kworker.0 Request processed in 418us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687762.506109:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788687762.506192:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839631488:0@lo:400:kworker.0 00010000:00010000:0.0:1788687762.952035:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687763.014448:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839632384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687763.014545:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687763.018537:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839632384 00000100:00100000:3.0:1788687763.018566:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839632384 00000100:00100000:3.0:1788687763.018879:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788687763.018890:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875574839632384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788687763.018946:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687763.019050:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875574839632384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (4505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687763.019057:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788687763.019209:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839632384:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788687763.334698:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788687763.974180:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687764.462541:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687764.462659:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687764.465870:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687764.465903:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687764.465948:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819675648 00000100:00100000:0.0:1788687764.465957:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819675648 00000100:00100000:0.0:1788687764.466030:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:0.0:1788687764.466040:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819675648:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687764.466112:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819675648:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687764.466120:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00080000:0.0:1788687764.466143:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687764.466770:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819675520 00000100:00100000:2.0:1788687764.466777:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819675520 00000100:00100000:3.0:1788687764.466787:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819675392 00000100:00100000:3.0:1788687764.466794:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819675392 00000100:00100000:3.0:1788687764.466835:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 276 00000100:00100000:2.0:1788687764.466836:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819675776 00000100:00100000:3.0:1788687764.466845:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819675392:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687764.466855:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819675776 00000100:00100000:3.0:1788687764.466887:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819675392:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687764.466890:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:3.0:1788687764.466899:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 276 00000100:00100000:2.0:1788687764.466904:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819675520:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687764.466940:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:3.0:1788687764.466948:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819675776:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687764.466971:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819675776:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (4313us total) trans 0 rc 0/0 00000100:00080000:1.0:1788687764.467002:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687764.467045:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:2.0:1788687764.467899:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819675520:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 994us (5374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687764.467908:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 107 00010000:00010000:0.0:1788687764.999402:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788687765.137218:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1788687766.022657:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687767.049268:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687767.621663:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839632512:0@lo:400:kworker.0 00000100:00100000:1.0:1788687767.621700:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839632768:0@lo:400:kworker.0 00000100:00100000:2.0:1788687767.621798:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839632640:0@lo:400:kworker.0 00000100:00100000:1.0:1788687767.623563:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687767.623643:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839633280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687767.623683:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687767.623715:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788687767.623721:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839632896:0@lo:400:kworker.0 00000100:00100000:1.0:1788687767.623745:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687767.623788:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839633280 00000100:00100000:1.0:1788687767.623797:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839633280 00000100:00100000:1.0:1788687767.623876:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788687767.623887:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839633280:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687767.624184:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839632768 00000100:00100000:3.0:1788687767.624189:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839632768 00000100:00100000:3.0:1788687767.624226:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788687767.624234:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839632768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687767.624290:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839632768:12345-0@lo:400:kworker.0 Request processed in 57us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687767.624309:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788687767.624378:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839632896 00000100:00100000:3.0:1788687767.624392:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839632896 00000100:00100000:3.0:1788687767.624416:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788687767.624422:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839632896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687767.624453:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839632896:12345-0@lo:400:kworker.0 Request processed in 31us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687767.624475:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788687767.624758:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788687767.624764:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788687767.624796:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c315ca80 x1875574839632896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687767.624812:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839632896:0@lo:400:kworker.0 00000100:00100000:3.0:1788687767.624825:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839632768:0@lo:400:kworker.0 00002000:00000024:1.0:1788687767.625246:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687767.625308:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839633280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1423us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687767.625316:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788687767.625713:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c82dbb80 x1875574839633280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687767.625735:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839633280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687767.627845:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687767.628082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839632512 00000100:00100000:3.0:1788687767.628091:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839632512 00000100:00100000:0.0:1788687767.628110:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839633024:0@lo:400:kworker.0 00000100:00100000:3.0:1788687767.628148:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788687767.628159:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839632512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687767.628168:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687767.628214:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839632512:12345-0@lo:400:kworker.0 Request processed in 57us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687767.628221:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788687767.628258:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839633024 00000100:00100000:0.0:1788687767.628264:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839633024 00000100:00100000:0.0:1788687767.628317:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788687767.628326:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839633024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687767.628366:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839632512:0@lo:400:kworker.0 00000100:00100000:0.0:1788687767.628369:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839633024:12345-0@lo:400:kworker.0 Request processed in 44us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687767.628378:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788687767.628428:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839633024:0@lo:400:kworker.0 00000100:00080000:3.0:1788687767.628579:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687767.628896:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687767.629062:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839633152:0@lo:400:kworker.0 00000100:00100000:2.0:1788687767.629090:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687767.629152:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839632640 00000100:00100000:3.0:1788687767.629156:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839632640 00000100:00100000:3.0:1788687767.629233:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788687767.629241:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839632640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687767.629285:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839633152 00000100:00100000:3.0:1788687767.629287:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839632640:12345-0@lo:400:kworker.0 Request processed in 47us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687767.629291:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839633152 00000100:00100000:0.0:1788687767.629328:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788687767.629335:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839633152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687767.629402:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788687767.629433:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839632640:0@lo:400:kworker.0 00000100:00100000:0.0:1788687767.629476:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839633152:12345-0@lo:400:kworker.0 Request processed in 140us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687767.629507:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788687767.629527:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687767.629742:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788687767.629748:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3c2e86a00, transno 4294967300 00000100:00100000:2.0:1788687767.629795:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839633152:0@lo:400:kworker.0 00010000:00010000:3.0:1788687768.069660:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687768.133918:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788687768.133953:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839633408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687768.134037:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687768.134185:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839633408 00000100:00100000:0.0:1788687768.134194:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839633408 00000100:00100000:0.0:1788687768.134251:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788687768.134262:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839633408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788687768.134305:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687768.134361:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839633408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687768.134368:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788687768.134688:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839633408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788687769.095126:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687769.580604:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687769.580886:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819675904 00000100:00100000:3.0:1788687769.580898:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819675904 00000100:00100000:3.0:1788687769.580980:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 278 00000100:00100000:3.0:1788687769.580991:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819675904:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687769.581078:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819675904:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 88us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687769.581086:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 278 00000100:00100000:0.0:1788687769.582918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687769.583023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687769.583177:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687769.583257:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819676160 00000100:00100000:3.0:1788687769.583267:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819676160 00000100:00100000:3.0:1788687769.583337:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00080000:0.0:1788687769.583494:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788687769.583605:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819676160:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687769.583712:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819676160:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 367us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687769.583721:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:2.0:1788687769.583773:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819676032 00000100:00100000:2.0:1788687769.583778:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819676032 00000100:00100000:2.0:1788687769.583827:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819676288 00000100:00100000:2.0:1788687769.583830:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819676288 00000100:00100000:2.0:1788687769.583853:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:2.0:1788687769.583860:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819676032:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687769.583894:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819676032:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 35us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687769.583900:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:2.0:1788687769.583931:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:2.0:1788687769.583938:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819676288:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687769.583964:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819676288:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 28us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687769.583970:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00080000:3.0:1788687769.584091:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788687770.118041:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687771.142089:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687772.166196:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687772.741707:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839633536:0@lo:400:kworker.0 00000100:00100000:0.0:1788687772.741753:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839633920:0@lo:400:kworker.0 00000100:00100000:1.0:1788687772.741796:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687772.741813:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687772.741924:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839633792:0@lo:400:kworker.0 00000100:00100000:2.0:1788687772.741954:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687772.742018:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839633664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687772.742252:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687772.742287:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839634176:0@lo:400:kworker.0 00000100:00100000:1.0:1788687772.742384:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687772.742436:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839633536 00000100:00100000:1.0:1788687772.742444:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839633536 00000100:00100000:1.0:1788687772.742529:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788687772.742540:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839633536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687772.742980:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839633664 00000100:00100000:1.0:1788687772.742986:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839633664 00000100:00100000:1.0:1788687772.743037:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788687772.743044:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839633664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788687772.743072:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687772.743227:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839633664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687772.743235:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788687772.743259:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839633920 00000100:00100000:1.0:1788687772.743263:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839633920 00000100:00100000:3.0:1788687772.744346:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839634304:0@lo:400:kworker.0 00000100:00100000:3.0:1788687772.744724:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788687772.744792:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788687772.744798:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788687772.744842:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839633536:12345-0@lo:400:kworker.0 Request processed in 2303us (3047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687772.744851:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788687772.745174:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788687772.745331:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839633536:0@lo:400:kworker.0 00010000:00080000:3.0:1788687772.745349:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c315f800 x1875574839633664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687772.745383:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839633664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687772.746928:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839634048:0@lo:400:kworker.0 00000100:00100000:0.0:1788687772.746992:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687772.747069:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839634304 00000100:00100000:0.0:1788687772.747076:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839634304 00000100:00100000:0.0:1788687772.747130:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839634048 00000100:00100000:0.0:1788687772.747133:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839634048 00000100:00100000:0.0:1788687772.747154:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788687772.747164:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839634304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687772.747346:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839634304:12345-0@lo:400:kworker.0 Request processed in 182us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687772.747354:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788687772.747381:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788687772.747388:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839634048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687772.747421:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839634048:12345-0@lo:400:kworker.0 Request processed in 34us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687772.747427:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788687772.747451:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788687772.747501:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839634304:0@lo:400:kworker.0 00010000:00080000:0.0:1788687772.747548:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3fb822680 x1875574839634048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687772.747558:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839634048:0@lo:400:kworker.0 00000100:00100000:3.0:1788687772.749037:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839633792 00000100:00100000:3.0:1788687772.749050:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839633792 00000100:00100000:2.0:1788687772.749923:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839634176 00000100:00100000:2.0:1788687772.749930:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839634176 00000100:00080000:0.0:1788687772.750036:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788687772.754680:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788687772.754706:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839633920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687772.755284:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839633920:12345-0@lo:400:kworker.0 Request processed in 589us (13469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687772.755306:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788687772.755834:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839633920:0@lo:400:kworker.0 00000100:00100000:1.0:1788687772.757284:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788687772.757307:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839634176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687772.757420:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839634176:12345-0@lo:400:kworker.0 Request processed in 124us (15035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687772.757427:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788687772.757462:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839634176:0@lo:400:kworker.0 00000100:00100000:3.0:1788687772.757717:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788687772.757728:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839633792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687772.757833:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839633792:12345-0@lo:400:kworker.0 Request processed in 108us (15877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687772.757840:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788687772.757915:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839633792:0@lo:400:kworker.0 00010000:00010000:0.0:1788687773.190842:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687773.254984:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839634432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687773.255088:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687773.255374:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839634432 00000100:00100000:1.0:1788687773.255384:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839634432 00000100:00100000:1.0:1788687773.255435:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788687773.255445:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839634432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687773.255507:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687773.255563:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839634432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687773.255570:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788687773.255616:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839634432:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788687773.574981:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788687774.215429:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687774.700707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687774.700755:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687774.700840:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819676544 00000100:00100000:3.0:1788687774.700850:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819676544 00000100:00100000:3.0:1788687774.700921:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:3.0:1788687774.700932:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2347:x1875574819676544:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687774.701003:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2347:x1875574819676544:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687774.701011:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:2.0:1788687774.701077:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819676416 00000100:00100000:2.0:1788687774.701083:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819676416 00000100:00100000:2.0:1788687774.701123:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 280 00000100:00100000:2.0:1788687774.701132:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819676416:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687774.701164:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819676416:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687774.701171:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 280 00000100:00080000:0.0:1788687774.701190:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687774.714272:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687774.714565:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687774.715103:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819676672 00000100:00100000:2.0:1788687774.715114:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819676672 00000100:00100000:2.0:1788687774.715259:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:2.0:1788687774.715272:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2345:x1875574819676672:12345-192.168.204.26@tcp:9:kworker.0 00000100:00080000:0.0:1788687774.715289:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1788687774.715302:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448ed3 00000100:00080000:2.0:1788687774.715338:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9af3f79ce800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788687774.715381:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788687774.715397:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687774.716050:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+2:2345:x1875574819676672:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 778us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687774.716060:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:3.0:1788687774.719342:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819676800 00000100:00100000:3.0:1788687774.719386:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819676800 00000100:00100000:3.0:1788687774.719555:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:3.0:1788687774.719568:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819676800:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687774.719676:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819676800:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 111us (5110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687774.719684:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00080000:0.0:1788687774.719949:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788687775.238449:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788687775.365305:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:0.0:1788687775.365324:0:7643:0:(genops.c:885:class_export_put()) final put ffff9af3f79c8800/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:3.0:1788687775.365395:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f79c8800/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f for lustre-OST0001 00000020:00000080:3.0:1788687775.365448:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3f79ce800 for lustre-OST0001 00010000:00010000:0.0:1788687776.262374:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687777.285603:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687777.862116:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839634944:0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.862191:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687777.862254:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788687777.862270:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839634560:0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.862303:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687777.862327:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839635072:0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.862356:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687777.862365:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839634560 00000100:00100000:3.0:1788687777.862375:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839634560 00000100:00100000:2.0:1788687777.862389:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839634688:0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.862415:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687777.862422:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788687777.862434:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839634560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.862438:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839635200:0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.862464:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687777.862509:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687777.862517:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839634816:0@lo:400:kworker.0 00000100:00100000:3.0:1788687777.862524:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839634560:12345-0@lo:400:kworker.0 Request processed in 92us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687777.862533:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788687777.862545:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687777.862581:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839634944 00000100:00100000:2.0:1788687777.862585:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839634944 00000100:00100000:2.0:1788687777.862624:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839635200 00000100:00100000:2.0:1788687777.862627:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839635200 00000100:00100000:2.0:1788687777.862652:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788687777.862659:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839634944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.862693:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839634944:12345-0@lo:400:kworker.0 Request processed in 35us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687777.862709:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788687777.862724:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788687777.862731:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839635200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.862768:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839635200:12345-0@lo:400:kworker.0 Request processed in 37us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687777.862774:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788687777.862792:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839635072 00000100:00100000:2.0:1788687777.862796:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839635072 00000100:00100000:2.0:1788687777.862821:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839634688 00000100:00100000:2.0:1788687777.862824:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839634688 00000100:00100000:2.0:1788687777.862834:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839634816 00000100:00100000:2.0:1788687777.862836:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839634816 00000100:00100000:2.0:1788687777.862849:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788687777.862855:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839635072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.862885:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839635072:12345-0@lo:400:kworker.0 Request processed in 30us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687777.862891:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788687777.862904:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788687777.862911:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839634688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.862941:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839634688:12345-0@lo:400:kworker.0 Request processed in 32us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687777.862947:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788687777.862954:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788687777.862966:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839634816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.863004:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839634688:0@lo:400:kworker.0 00000100:00100000:3.0:1788687777.863010:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839634816:12345-0@lo:400:kworker.0 Request processed in 46us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687777.863018:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788687777.863021:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839635200:0@lo:400:kworker.0 00000100:00100000:2.0:1788687777.863046:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839634816:0@lo:400:kworker.0 00000100:00100000:3.0:1788687777.863067:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839634560:0@lo:400:kworker.0 00000100:00100000:3.0:1788687777.863086:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839635072:0@lo:400:kworker.0 00010000:00080000:3.0:1788687777.863099:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c8836680 x1875574839634944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687777.863116:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839634944:0@lo:400:kworker.0 00000100:00080000:0.0:1788687777.863230:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788687777.863235:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788687777.863237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687777.864238:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839635328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788687777.864298:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687777.864547:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839635328 00000100:00100000:1.0:1788687777.864555:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839635328 00000100:00100000:1.0:1788687777.864604:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788687777.864614:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839635328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788687777.864813:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687777.864934:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839635328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 321us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687777.864959:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1788687777.865115:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c315f100 x1875574839635328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687777.865134:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839635328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788687778.309763:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687778.375628:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788687778.375652:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839635456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687778.375720:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687778.376070:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839635456 00000100:00100000:2.0:1788687778.376079:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839635456 00000100:00100000:2.0:1788687778.376127:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788687778.376137:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839635456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788687778.376171:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687778.376261:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839635456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687778.376269:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788687778.376875:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839635456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788687779.334498:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687779.820167:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687779.820216:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687779.820263:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687779.820368:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819677184 00000100:00100000:1.0:1788687779.820369:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819676928 00000100:00100000:3.0:1788687779.820381:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819677184 00000100:00100000:1.0:1788687779.820381:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819676928 00000100:00100000:3.0:1788687779.820441:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819677056 00000100:00100000:1.0:1788687779.820442:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 282 00000100:00100000:3.0:1788687779.820446:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819677056 00000100:00100000:1.0:1788687779.820459:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819676928:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687779.820474:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:3.0:1788687779.820512:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819677184:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687779.820562:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819676928:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 109us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687779.820570:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 282 00000100:00100000:3.0:1788687779.820665:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819677184:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 183us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687779.821377:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00080000:0.0:1788687779.821439:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788687779.823035:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:1.0:1788687779.823056:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819677056:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687779.823133:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819677056:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 88us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687779.823141:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 123 00010000:00010000:0.0:1788687780.358466:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687781.382270:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687782.416581:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687782.982276:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839635968:0@lo:400:kworker.0 00000100:00100000:2.0:1788687782.982348:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687782.982407:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788687782.982415:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839635584:0@lo:400:kworker.0 00000100:00100000:2.0:1788687782.982447:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687782.982454:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839635840:0@lo:400:kworker.0 00000100:00100000:2.0:1788687782.982477:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839636096:0@lo:400:kworker.0 00000100:00100000:3.0:1788687782.982515:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687782.982537:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839635968 00000100:00100000:2.0:1788687782.982545:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839635968 00000100:00100000:3.0:1788687782.982549:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788687782.982557:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839635712:0@lo:400:kworker.0 00000100:00100000:3.0:1788687782.982585:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687782.982603:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839636224:0@lo:400:kworker.0 00000100:00100000:3.0:1788687782.982624:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687782.982652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839635840 00000100:00100000:3.0:1788687782.982656:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839635840 00000100:00100000:3.0:1788687782.982758:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839635712 00000100:00100000:3.0:1788687782.982762:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839635712 00000100:00100000:3.0:1788687782.982787:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788687782.982796:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839635840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687782.982848:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839635840:12345-0@lo:400:kworker.0 Request processed in 52us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687782.982868:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788687782.982884:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788687782.982952:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839635712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687782.982960:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839636224 00000100:00100000:2.0:1788687782.982965:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839636224 00000100:00100000:3.0:1788687782.982986:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839635712:12345-0@lo:400:kworker.0 Request processed in 37us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687782.982995:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788687782.982999:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788687782.983009:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839635968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687782.983039:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839635712:0@lo:400:kworker.0 00000100:00100000:3.0:1788687782.983056:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839635840:0@lo:400:kworker.0 00000100:00100000:2.0:1788687782.983062:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839635968:12345-0@lo:400:kworker.0 Request processed in 55us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687782.983071:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788687782.983088:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788687782.983095:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839636224:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788687782.983102:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788687782.983109:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788687782.983112:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788687782.983122:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839635584 00000100:00100000:3.0:1788687782.983126:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839635584 00000100:00100000:3.0:1788687782.983152:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788687782.983159:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839635584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687782.983245:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788687782.983256:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839636352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687782.985779:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839635584:12345-0@lo:400:kworker.0 Request processed in 2609us (3319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687782.985794:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788687782.986963:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839636224:12345-0@lo:400:kworker.0 Request processed in 3863us (4333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687782.986976:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788687782.987042:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839636224:0@lo:400:kworker.0 00000100:00100000:1.0:1788687782.987083:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687782.987221:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839636352 00000100:00100000:2.0:1788687782.987229:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839636352 00000100:00100000:2.0:1788687782.987291:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788687782.987300:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839636352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788687782.987378:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687782.987440:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839636352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687782.987448:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788687782.987590:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c315c380 x1875574839636352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687782.987612:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839636352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687782.988139:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788687782.988193:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c8834e00 x1875574839635968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788687798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687782.988204:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839635968:0@lo:400:kworker.0 00000100:00100000:0.0:1788687782.988225:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839635584:0@lo:400:kworker.0 00000100:00100000:0.0:1788687782.992436:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839636096 00000100:00100000:0.0:1788687782.992452:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839636096 00000100:00100000:0.0:1788687782.992568:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1788687782.992576:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687782.992582:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839636096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687782.992697:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839636096:12345-0@lo:400:kworker.0 Request processed in 120us (4558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687782.992705:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788687782.992994:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839636096:0@lo:400:kworker.0 00010000:00010000:3.0:1788687783.429660:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687783.493895:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788687783.493918:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839636480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687783.493981:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687783.494125:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839636480 00000100:00100000:1.0:1788687783.494133:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839636480 00000100:00100000:1.0:1788687783.494199:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788687783.494209:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839636480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687783.494245:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687783.494321:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839636480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687783.494329:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788687783.494507:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839636480:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788687783.819306:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788687784.357253:0:11852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 05:43:02 (1788687782) 00010000:00010000:2.0:1788687784.455046:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687784.938531:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687784.938576:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687784.938621:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687784.938762:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819677312 00000100:00100000:3.0:1788687784.938772:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819677312 00000100:00100000:3.0:1788687784.938838:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 284 00000100:00100000:3.0:1788687784.938848:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819677312:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687784.938915:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819677312:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 69us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687784.938922:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 284 00000100:00100000:2.0:1788687784.943881:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819677568 00000100:00100000:2.0:1788687784.943898:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819677568 00000100:00100000:2.0:1788687784.944001:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819677440 00000100:00100000:2.0:1788687784.944005:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819677440 00000100:00100000:2.0:1788687784.944058:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:2.0:1788687784.944082:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819677568:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687784.944182:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819677568:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 102us (5605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687784.944189:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:2.0:1788687784.944208:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:2.0:1788687784.944214:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2347:x1875574819677440:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687784.944241:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2347:x1875574819677440:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 27us (5620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687784.944246:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00080000:3.0:1788687784.944512:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788687785.477714:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687786.033129:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687786.033310:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819677696 00000100:00100000:2.0:1788687786.033325:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819677696 00000100:00100000:2.0:1788687786.033423:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:2.0:1788687786.033437:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:10229:x1875574819677696:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788687786.033465:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788687786.034263:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788687786.035235:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74448f9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b58 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687786.035325:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74448fa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687786.035340:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74448fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687786.035354:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74448fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687786.035396:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788687786.035415:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687786.035795:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74448fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687786.035825:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74448f9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b58 expref: 7 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687786.035847:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74448fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b58 expref: 6 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687786.035855:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3e29fe700) 00010000:00010000:2.0:1788687786.035858:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687786.035861:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2e00, rc 0) 00000100:00100000:2.0:1788687786.036019:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:10229:x1875574819677696:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 2586us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687786.036029:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:2.0:1788687786.041924:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687786.042182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819677824 00000100:00100000:1.0:1788687786.042194:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819677824 00000100:00100000:1.0:1788687786.042311:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:1.0:1788687786.042323:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:10231:x1875574819677824:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687786.042345:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687786.042368:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74448fac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b5f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.042441:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74448fb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.042471:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74448fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.042515:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74448fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.042531:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74448fba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.042538:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74448fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.042557:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74448fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.042947:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cdc00/0xc2ddd83e74448fc1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.042964:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cdc00/0xc2ddd83e74448fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.042972:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cdc00/0xc2ddd83e74448fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687786.043001:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788687786.043005:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687786.043028:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cdc00/0xc2ddd83e74448fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043039:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74448fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043045:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74448fb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043052:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74448fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043058:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cde00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687786.043063:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74448fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043070:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74448fb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043082:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3e29fe700) 00010000:00010000:1.0:1788687786.043085:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687786.043089:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74448fb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043117:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74448fb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043132:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74448fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043138:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74448fba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043143:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74448fba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043149:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687786.043152:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74448fba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043158:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74448fba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043166:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9af3c7fb4d00) 00010000:00010000:1.0:1788687786.043168:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687786.043171:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74448fba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043176:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74448fba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043209:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74448fac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b5f expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043222:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cdc00/0xc2ddd83e74448fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b5f expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687786.043236:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9af3c7fb4c00) 00010000:00010000:1.0:1788687786.043239:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788687786.043241:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cdc00, rc 0) 00000100:00100000:1.0:1788687786.043308:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:10231:x1875574819677824:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 987us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687786.043316:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:1.0:1788687786.065429:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687786.065538:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819678080 00000100:00100000:0.0:1788687786.065548:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819678080 00000100:00100000:0.0:1788687786.065612:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:0.0:1788687786.065622:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:10231:x1875574819678080:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788687786.065642:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687786.065661:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448fc8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.065734:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448fcf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.065760:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448fcf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.065771:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448fcf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.065843:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448fd6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.065850:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.065867:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066470:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448fdd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066526:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448fdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066535:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448fdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687786.066545:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788687786.066687:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448fcf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066695:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448fcf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066701:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448fcf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066715:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ece00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687786.066720:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448fcf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066728:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448fcf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066740:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9af3c7fb4c00) 00010000:00010000:0.0:1788687786.066743:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687786.066746:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448fcf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066752:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74448fcf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066765:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066771:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066776:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066781:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687786.066784:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066789:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066805:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9af3d2736100) 00010000:00010000:0.0:1788687786.066808:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687786.066811:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448fd6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.066816:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e74448fd6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.068467:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448fc8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b66 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.068533:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448fdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b66 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687786.068543:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:0.0:1788687786.068546:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687786.068549:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed400, rc 0) 00000100:00100000:0.0:1788687786.068960:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:10231:x1875574819678080:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 3337us (3539us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788687786.068970:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:3.0:1788687786.082609:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687786.085714:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819678208 00000100:00100000:0.0:1788687786.085730:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819678208 00000100:00100000:0.0:1788687786.085819:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:0.0:1788687786.085830:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:10231:x1875574819678208:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788687786.085966:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:10231:x1875574819678208:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 137us (3371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687786.085974:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00010000:00010000:2.0:1788687786.501919:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788687786.887342:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788687787.526844:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687787.924528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687787.925364:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819678336 00000100:00100000:0.0:1788687787.925375:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819678336 00000100:00100000:0.0:1788687787.925444:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:0.0:1788687787.925455:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:10273:x1875574819678336:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687787.925475:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687787.925511:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448feb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b6d expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925576:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74448ff2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925592:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74448ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925604:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74448ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925619:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448ff9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925625:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925631:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925809:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74448ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925817:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74448ff2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925835:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74448ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925841:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687787.925846:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74448ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925854:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74448ff2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925867:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3e29fe700) 00010000:00010000:0.0:1788687787.925870:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687787.925874:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74448ff2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925880:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74448ff2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925890:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925895:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448ff9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925901:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925906:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687787.925909:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925925:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925934:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9af3d2736d00) 00010000:00010000:0.0:1788687787.925936:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687787.925938:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448ff9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925944:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74448ff9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925977:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448feb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b6d expref: 10 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.925987:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3e29fe700) 00010000:00010000:0.0:1788687787.925990:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687787.925993:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74448feb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b6d expref: 10 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.926002:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec000, rc 0) 00000100:00100000:0.0:1788687787.926063:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:10273:x1875574819678336:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 610us (1543us total) trans 0 rc 301/301 00000100:00100000:0.0:1788687787.926081:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:1.0:1788687787.935443:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687787.936689:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819678592 00000100:00100000:0.0:1788687787.936703:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819678592 00000100:00100000:0.0:1788687787.936783:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:0.0:1788687787.936796:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:10273:x1875574819678592:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:0.0:1788687787.936871:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687787.936963:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74448fa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b58 expref: 9 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.936983:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3e29fe700) 00010000:00010000:0.0:1788687787.936996:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788687787.937245:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449000 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.937260:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449000 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.937270:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449000 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.937285:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.937292:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.937538:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687787.939797:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788687787.939819:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449000 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.939830:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449000 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.939837:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449000 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.939850:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687787.939856:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449000 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.939864:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449000 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.939895:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736a00) 00010000:00010000:0.0:1788687787.939898:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687787.939903:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449000 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687787.939911:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449000 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788687787.939934:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d15f8243 reply state 000000000b52471d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687787.939943:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788687787.940088:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:10273:x1875574819678592:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 3290us (4649us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788687787.940099:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00010000:00010000:1.0:1788687787.947539:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687787.947556:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687787.947564:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687787.947570:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687787.947575:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687787.947585:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687787.947602:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9af3d2736c00) 00010000:00010000:1.0:1788687787.947606:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687787.947611:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687787.947629:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449007 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687788.027474:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.027612:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819678720 00000100:00100000:2.0:1788687788.027622:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819678720 00000100:00080000:3.0:1788687788.027766:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687788.027834:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:0.0:1788687788.027848:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:10281:x1875574819678720:12345-192.168.204.26@tcp:101:lctl.0 00010000:00010000:0.0:1788687788.027879:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687788.027906:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444900e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b74 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.027979:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449015 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.028010:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.028022:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687788.028221:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788687788.028226:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687788.028271:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.028298:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444900e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b74 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.028317:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449015 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b74 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.028327:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:0.0:1788687788.028330:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687788.028333:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec000, rc 0) 00000100:00100000:0.0:1788687788.028703:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:10281:x1875574819678720:12345-192.168.204.26@tcp:101:lctl.0 Request processed in 855us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687788.028714:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:3.0:1788687788.063094:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687788.063218:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819678848 00000100:00100000:1.0:1788687788.063234:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819678848 00000100:00100000:1.0:1788687788.063319:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:1.0:1788687788.063330:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:10287:x1875574819678848:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788687788.063352:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687788.063373:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444901c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b7b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063445:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449023 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063459:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063550:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063580:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444902a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063588:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444902a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063594:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444902a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063718:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cca00/0xc2ddd83e74449031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063727:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cca00/0xc2ddd83e74449031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063734:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cca00/0xc2ddd83e74449031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687788.063760:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788687788.063763:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687788.063812:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cca00/0xc2ddd83e74449031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063825:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063831:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449023 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063838:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449023 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063844:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687788.063849:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449023 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063856:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449023 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063869:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:1.0:1788687788.063877:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687788.063882:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063889:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063904:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444902a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063910:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444902a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063916:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444902a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063921:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687788.063924:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444902a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063930:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444902a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063938:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9af3c7fb4d00) 00010000:00010000:1.0:1788687788.063940:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687788.063943:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444902a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063949:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444902a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.063981:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444901c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b7b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.064007:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cca00/0xc2ddd83e74449031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b7b expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.064015:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:1.0:1788687788.064017:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788687788.064019:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cca00, rc 0) 00000100:00100000:1.0:1788687788.064255:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:10287:x1875574819678848:12345-192.168.204.26@tcp:101:bash.0 Request processed in 927us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687788.064263:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:2.0:1788687788.067248:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687788.067339:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819679104 00000100:00100000:0.0:1788687788.067353:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819679104 00000100:00100000:0.0:1788687788.067438:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:0.0:1788687788.067451:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:10287:x1875574819679104:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788687788.068267:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687788.068317:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449038 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b82 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.068697:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e7444903f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.068716:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e7444903f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.068731:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e7444903f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.068749:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.068756:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.068761:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788687788.069660:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788687788.069895:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.069908:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.069918:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.069960:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e7444903f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.069980:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e7444903f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.069988:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e7444903f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.069995:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687788.070001:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e7444903f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.070009:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e7444903f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.070023:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687788.070026:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687788.070032:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e7444903f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.070038:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e7444903f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788687788.070054:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001dc32bb4 reply state 00000000fddd9460 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687788.070075:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788687788.070120:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449038 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b82 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.070138:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b82 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.070156:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687788.070159:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788687788.070162:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79eca00, rc 0) 00000100:00100000:0.0:1788687788.070268:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:10287:x1875574819679104:12345-192.168.204.26@tcp:101:bash.0 Request processed in 2820us (3039us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788687788.070279:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00010000:00010000:3.0:1788687788.074170:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.074194:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.074203:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.074209:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687788.074216:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.074226:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.074249:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3d2736a00) 00010000:00010000:3.0:1788687788.074252:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687788.074278:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.074286:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449046 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687788.075021:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687788.075099:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819679232 00000100:00100000:0.0:1788687788.075113:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819679232 00000100:00100000:0.0:1788687788.075175:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:0.0:1788687788.075187:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875574819679232:12345-192.168.204.26@tcp:8:bash.0 00010000:00080000:0.0:1788687788.075244:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:0.0:1788687788.075319:0:6687:0:(genops.c:1385:class_connect()) connect: client bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f, cookie 0xc2ddd83e7444905b 00002000:00100000:0.0:1788687788.075339:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f/ffff9af3fc394800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788687788.075390:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788687788.077405:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788687788.077469:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9af3fc391000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788687788.077809:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2345:x1875574819679232:12345-192.168.204.26@tcp:8:bash.0 Request processed in 2620us (2796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687788.077828:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:2.0:1788687788.080050:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687788.080192:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819679360 00000100:00100000:0.0:1788687788.080204:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819679360 00000100:00100000:0.0:1788687788.080390:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:0.0:1788687788.080403:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:0:x1875574819679360:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788687788.080427:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687788.080528:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449062 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b89 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788687788.080568:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788687788.080592:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=333s v=(0 0) 00010000:00010000:0.0:1788687788.080597:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687788.080609:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449062 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b89 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.080634:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449062 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b89 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.080651:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed800, rc 0) 00000100:00100000:0.0:1788687788.080721:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:0:x1875574819679360:12345-192.168.204.26@tcp:101:bash.0 Request processed in 320us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687788.080727:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00080000:3.0:1788687788.081282:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788687788.084872:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687788.085053:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819679488 00000100:00100000:0.0:1788687788.085078:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819679488 00000100:00100000:0.0:1788687788.085211:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:0.0:1788687788.085234:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:10287:x1875574819679488:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788687788.085260:0:8309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687788.085284:0:8309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b90 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.085323:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449062 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b89 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.085357:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687788.085370:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687788.085377:0:8309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 8 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.085423:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449062 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b89 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.085437:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449062 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b89 expref: 8 pid: 6689 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687788.085454:0:8309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8309:1875574839636608:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687788.085625:0:8309:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f3d76600 going to sleep for 11 seconds 00000100:00100000:1.0:1788687788.089665:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.089804:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819679616 00000100:00100000:2.0:1788687788.089818:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819679616 00010000:00010000:2.0:1788687788.089880:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449062 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b89 expref: 9 pid: 6689 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687788.090010:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:0.0:1788687788.090011:0:8309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8309:1875574839636608:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687788.090021:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2348:x1875574819679616:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687788.090039:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687788.090050:0:8309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 9 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.090080:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449062 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b89 expref: 9 pid: 6689 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.090081:0:8309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec600, rc 0) 00010000:00010000:2.0:1788687788.090093:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449062 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b89 expref: 9 pid: 6689 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.090120:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449062 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b89 expref: 9 pid: 6689 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.090140:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687788.090146:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687788.090156:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 8 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687788.090162:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:10287:x1875574819679488:12345-192.168.204.26@tcp:101:bash.0 Request processed in 4941us (5304us total) trans 0 rc 0/0 00010000:00010000:2.0:1788687788.090168:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 8 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687788.090170:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00010000:00010000:2.0:1788687788.090209:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 7 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687788.090236:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8834e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1875574839636736:192.168.204.26@tcp:105: 00000100:00100000:2.0:1788687788.090308:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c623ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788687788.094431:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8834e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1875574839636736:192.168.204.26@tcp:105: 00010000:00010000:2.0:1788687788.094475:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687788.095632:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819679616:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 5602us (5974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687788.095647:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:3.0:1788687788.096102:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.096443:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819679872 00000100:00100000:2.0:1788687788.096454:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819679872 00000100:00100000:2.0:1788687788.097044:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:2.0:1788687788.097056:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10287:x1875574819679872:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:2.0:1788687788.098048:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:10287:x1875574819679872:12345-192.168.204.26@tcp:35:bash.0 Request processed in 988us (1977us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788687788.098060:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:0.0:1788687788.102756:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839636864:0@lo:400:kworker.0 00000100:00100000:0.0:1788687788.102863:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687788.102879:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839637248:0@lo:400:kworker.0 00000100:00100000:1.0:1788687788.102922:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687788.102931:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839636864 00000100:00100000:0.0:1788687788.102936:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839637504:0@lo:400:kworker.0 00000100:00100000:3.0:1788687788.102946:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839636864 00000100:00100000:0.0:1788687788.102975:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687788.102980:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839636992:0@lo:400:kworker.0 00000100:00100000:1.0:1788687788.103012:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687788.103029:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788687788.103038:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839637376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687788.103046:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839636864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687788.103083:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687788.103097:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839637504 00000100:00100000:0.0:1788687788.103104:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839637504 00000100:00100000:1.0:1788687788.103122:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788687788.103132:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839637120:0@lo:400:kworker.0 00000100:00100000:3.0:1788687788.103166:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839636864:12345-0@lo:400:kworker.0 Request processed in 123us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687788.103176:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687788.103180:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788687788.103213:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839637632:0@lo:400:kworker.0 00000100:00100000:1.0:1788687788.103239:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687788.103282:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839637248 00000100:00100000:1.0:1788687788.103288:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839637376 00000100:00100000:3.0:1788687788.103290:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839637248 00000100:00100000:1.0:1788687788.103301:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839637376 00000100:00100000:3.0:1788687788.103357:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839637632 00000100:00100000:1.0:1788687788.103366:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788687788.103374:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788687788.103394:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839637248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687788.103395:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839637376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788687788.103428:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687788.103456:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839636992 00000100:00100000:3.0:1788687788.103460:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839637632 00000100:00100000:0.0:1788687788.103462:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839636992 00000100:00100000:1.0:1788687788.103476:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839637376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687788.103514:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788687788.103515:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839637248:12345-0@lo:400:kworker.0 Request processed in 125us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687788.103525:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839637120 00000100:00100000:2.0:1788687788.103526:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788687788.103530:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839637120 00000100:00100000:2.0:1788687788.103558:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788687788.103562:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788687788.103573:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839637504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687788.103574:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839637248:0@lo:400:kworker.0 00000100:00100000:2.0:1788687788.103583:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839637632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687788.103617:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839637504:12345-0@lo:400:kworker.0 Request processed in 47us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687788.103621:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839637376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687788.103623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788687788.103637:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788687788.103641:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788687788.103643:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839636992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687788.103647:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839637120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687788.103691:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839637120:12345-0@lo:400:kworker.0 Request processed in 43us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687788.103691:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839636992:12345-0@lo:400:kworker.0 Request processed in 47us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687788.103697:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788687788.103700:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1788687788.103961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788687788.103966:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788687788.103969:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687788.104140:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839637632:12345-0@lo:400:kworker.0 Request processed in 572us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687788.104148:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788687788.104466:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839637504:0@lo:400:kworker.0 00000100:00100000:0.0:1788687788.104519:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839636864:0@lo:400:kworker.0 00000100:00100000:3.0:1788687788.106286:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839637120:0@lo:400:kworker.0 00000100:00100000:3.0:1788687788.106304:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839637632:0@lo:400:kworker.0 00000100:00100000:3.0:1788687788.106315:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839636992:0@lo:400:kworker.0 00000001:00100000:3.0:1788687788.136997:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000100:00100000:3.0:1788687788.163560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687788.164046:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819680128 00000100:00100000:0.0:1788687788.164057:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819680128 00000100:00100000:0.0:1788687788.164134:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:0.0:1788687788.164145:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:10297:x1875574819680128:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687788.164328:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687788.164352:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687788.164453:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788687788.166437:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449070 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b97 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.166458:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:1.0:1788687788.166461:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788687788.166467:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b97 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.166515:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79edc00, rc 0) 00000100:00100000:1.0:1788687788.166590:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:10297:x1875574819680128:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 2447us (3042us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788687788.166598:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:3.0:1788687788.168949:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687788.169122:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819680384 00000100:00100000:1.0:1788687788.169144:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819680384 00000100:00100000:1.0:1788687788.169275:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:1.0:1788687788.169287:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:10297:x1875574819680384:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788687788.169992:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:10297:x1875574819680384:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 704us (1049us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788687788.170001:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:3.0:1788687788.221044:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687788.221342:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819680512 00000100:00100000:0.0:1788687788.221360:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819680512 00000100:00100000:0.0:1788687788.221456:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:0.0:1788687788.221468:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:10303:x1875574819680512:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687788.221549:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687788.221574:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e7444907e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462b9e expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.221640:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e74449085 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.221654:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e74449085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.221665:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e74449085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687788.221699:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788687788.221703:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687788.221721:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e74449085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.221749:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e7444907e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b9e expref: 18 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.221787:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e74449085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b9e expref: 17 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.221796:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687788.221799:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687788.221803:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec400, rc 0) 00000100:00100000:0.0:1788687788.221870:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:10303:x1875574819680512:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 405us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687788.221878:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:3.0:1788687788.226789:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687788.227031:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819680768 00000100:00100000:1.0:1788687788.227045:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819680768 00000100:00100000:1.0:1788687788.227134:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:1.0:1788687788.227148:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:10303:x1875574819680768:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687788.227181:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687788.227209:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e7444908c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ba5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.227343:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449093 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.227366:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.227380:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687788.227393:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788687788.227730:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e7444908c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ba5 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.227756:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ba5 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.227784:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:1.0:1788687788.227787:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687788.227791:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cde00, rc 0) 00000100:00100000:1.0:1788687788.227872:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:10303:x1875574819680768:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 727us (1100us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788687788.227880:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:3.0:1788687788.230902:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.231238:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819680896 00000100:00100000:2.0:1788687788.231252:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819680896 00000100:00100000:2.0:1788687788.231394:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:2.0:1788687788.231407:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:2347:x1875574819680896:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687788.231430:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687788.231462:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449093 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ba5 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.231523:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:2.0:1788687788.231530:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687788.231804:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:2347:x1875574819680896:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 399us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687788.231814:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:3.0:1788687788.233648:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687788.233810:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819681152 00000100:00100000:0.0:1788687788.233825:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819681152 00000100:00100000:0.0:1788687788.233901:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:0.0:1788687788.234012:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:10303:x1875574819681152:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687788.234050:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687788.234089:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462bac expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.234217:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e744490a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.234431:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e744490a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.234446:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e744490a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687788.234462:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788687788.234707:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bac expref: 21 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.234733:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e744490a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bac expref: 20 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.234744:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687788.234748:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788687788.234752:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ede00, rc 0) 00000100:00100000:0.0:1788687788.234883:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:10303:x1875574819681152:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 971us (1248us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788687788.234892:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:1.0:1788687788.241209:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687788.241677:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819681280 00000100:00100000:3.0:1788687788.241692:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819681280 00000100:00100000:3.0:1788687788.241783:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788687788.241796:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819681280:12345-192.168.204.26@tcp:1:lfs.0 00010000:00010000:3.0:1788687788.241866:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.241895:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 6 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.241906:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687788.241911:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687788.241917:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.241966:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 6 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.241985:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 6 pid: 8309 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687788.242003:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875574839637760:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687788.242153:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687788.247523:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.248598:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819681408 00000100:00100000:2.0:1788687788.248619:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819681408 00002000:00100000:2.0:1788687788.248695:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9af3c5b16300 x1875574819681408/t0(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:689/0 lens 504/0 e 0 to 0 dl 1788687799 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788687788.248708:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c5b16300 with x1875574819681408 ext(0->12) 00010000:00010000:2.0:1788687788.248720:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 7 pid: 8309 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.248741:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 7 pid: 8309 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788687788.248750:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9af3c5b16300 00000100:00100000:2.0:1788687788.248804:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:2.0:1788687788.248815:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819681408:12345-192.168.204.26@tcp:4:lfs.0 00000100:00100000:3.0:1788687788.250575:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875574839637760:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687788.250626:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687788.256926:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2349:x1875574819681408:12345-192.168.204.26@tcp:4:lfs.0 Request processed in 8099us (9444us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788687788.256951:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00002000:00100000:2.0:1788687788.256965:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9af3c5b16300 x1875574819681408/t4294967299(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:689/0 lens 504/448 e 0 to 0 dl 1788687799 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788687788.256976:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c5b16300 with x1875574819681408 ext(0->12) 00010000:00010000:2.0:1788687788.257535:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 9 pid: 8309 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.257558:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 9 pid: 8309 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788687788.257567:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9af3c5b16300 00000100:00100000:1.0:1788687788.262162:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687788.262950:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819681536 00000100:00100000:3.0:1788687788.262968:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819681536 00010000:00010000:3.0:1788687788.263033:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 9 pid: 8309 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687788.263103:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:3.0:1788687788.263116:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2347:x1875574819681536:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687788.263137:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788687788.263165:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788687788.263169:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788687787 00002000:00010000:3.0:1788687788.263171:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788687787 00002000:00010000:3.0:1788687788.263174:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788687787 00010000:00010000:3.0:1788687788.263181:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 9 pid: 8309 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.263198:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 9 pid: 8309 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.263237:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c48a/0xc2ddd83e74449069 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b90 expref: 9 pid: 8309 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.263272:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687788.263277:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687788.263310:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.263323:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.263375:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687788.263455:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2347:x1875574819681536:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 341us (1311us total) trans 0 rc 0/0 00010000:00010000:0.0:1788687788.263465:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687788.263467:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00010000:00010000:0.0:1788687788.263533:0:6686:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.263575:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.263594:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.263603:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.263631:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687788.263635:0:6686:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.263645:0:6686:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.263664:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.263672:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bb2e5d2/0xc2ddd83e744490b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687788.263766:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819681280:12345-192.168.204.26@tcp:1:lfs.0 Request processed in 21969us (22570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687788.263775:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:1.0:1788687788.269785:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.269877:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819681792 00000100:00100000:2.0:1788687788.269896:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819681792 00000100:00100000:2.0:1788687788.269999:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788687788.270014:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:10303:x1875574819681792:12345-192.168.204.26@tcp:35:lfs.0 00000004:00010000:2.0:1788687788.270114:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e744490a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bac expref: 20 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788687788.270944:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788687788.271013:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788687788.275502:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788687788.275628:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.275651:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b82 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.275674:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.275715:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b82 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.275733:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b82 expref: 24 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687788.275750:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8837480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875574839637888:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687788.275845:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c623e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687788.279838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687788.279934:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819681920 00000100:00100000:3.0:1788687788.279949:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819681920 00010000:00010000:3.0:1788687788.280006:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b82 expref: 25 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687788.280084:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:2.0:1788687788.280085:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8837480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875574839637888:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687788.280101:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+25:2349:x1875574819681920:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687788.280121:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.280123:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687788.280140:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b82 expref: 25 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.280162:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b82 expref: 25 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.280192:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444904d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b82 expref: 25 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.280213:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687788.280238:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.280250:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.280259:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687788.280296:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687788.281155:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:2349:x1875574819681920:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 1052us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687788.281168:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00010000:00010000:2.0:1788687788.281212:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.281226:0:5842:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788687788.281372:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788687788.281655:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788687788.281781:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8837480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875574839638016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788687788.281900:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687788.281938:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c623e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788687788.282047:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839638016 00000100:00100000:3.0:1788687788.282058:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839638016 00000100:00100000:3.0:1788687788.282130:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788687788.282139:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875574839638016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788687788.282260:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875574839638016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 122us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687788.282267:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788687788.282336:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8837480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875574839638016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788687788.284474:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788687788.285018:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875574839638144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788687788.285156:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687788.285251:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d0171480 going to sleep for 11 seconds 00000100:00100000:3.0:1788687788.285850:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839638144 00000100:00100000:3.0:1788687788.285860:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839638144 00000100:00100000:3.0:1788687788.286170:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687788.286183:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875574839638144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788687788.286661:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875574839638144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 373us (1397us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788687788.286745:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875574839638144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788687788.286815:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788687788.286870:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.286881:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.286889:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.286895:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687788.286899:0:5842:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.286907:0:5842:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.286923:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687788.286926:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788687788.286931:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.286937:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788687788.287141:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788687788.287367:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788687788.287379:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333977897561ns, next at 334977895497ns, rc = 0 00000001:00080000:0.0:1788687788.287387:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788687788.287420:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687788.287423:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788687788.287431:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e744490a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bac expref: 28 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687788.287575:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:10303:x1875574819681792:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 17565us (17802us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788687788.287667:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000020:00080000:0.0:1788687788.287672:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788687788.288297:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788687788.291733:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687788.291841:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819682048 00000100:00100000:1.0:1788687788.291851:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819682048 00000100:00100000:1.0:1788687788.292051:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:1.0:1788687788.292140:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:10303:x1875574819682048:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687788.292165:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687788.292192:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744490c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462bb3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.292257:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744490c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bb3 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.292272:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744490c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bb3 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.292291:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:1.0:1788687788.292307:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687788.292311:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc400, rc 0) 00000100:00100000:1.0:1788687788.292432:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:10303:x1875574819682048:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 371us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687788.292439:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:1.0:1788687788.297439:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687788.297571:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819682304 00000100:00100000:0.0:1788687788.297690:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819682304 00000100:00100000:0.0:1788687788.297755:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:0.0:1788687788.297766:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b97c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:10303:x1875574819682304:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788687788.298246:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b97c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:10303:x1875574819682304:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 480us (816us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788687788.298256:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:3.0:1788687788.401833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.402040:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819682560 00000100:00100000:2.0:1788687788.402082:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819682560 00000100:00100000:2.0:1788687788.402149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:2.0:1788687788.402161:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:10313:x1875574819682560:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687788.402188:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687788.402210:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744490cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462bba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687788.402310:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788687788.402448:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744490cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bba expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.402463:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:2.0:1788687788.402466:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788687788.402471:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744490cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bba expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.402531:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3600, rc 0) 00000100:00100000:2.0:1788687788.402610:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+30:10313:x1875574819682560:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 452us (790us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788687788.402618:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:3.0:1788687788.405867:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.405985:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819682688 00000100:00100000:2.0:1788687788.405995:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819682688 00000100:00100000:2.0:1788687788.406054:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:2.0:1788687788.406077:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+30:10313:x1875574819682688:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:2.0:1788687788.406152:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406168:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406187:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406202:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744490e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406208:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744490e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406214:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744490e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406296:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406303:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406309:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788687788.406351:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406363:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406369:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406376:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406393:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687788.406397:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406406:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406418:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:2.0:1788687788.406422:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687788.406426:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406432:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744490d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406448:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744490e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406455:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744490e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406461:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744490e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406465:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3a00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687788.406468:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744490e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406473:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744490e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406520:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3e29fe400) 00010000:00010000:2.0:1788687788.406523:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687788.406526:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744490e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406532:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744490e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406549:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406555:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406560:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406565:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687788.406567:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406573:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406758:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:2.0:1788687788.406762:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687788.406765:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.406771:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744490e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687788.406869:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+30:10313:x1875574819682688:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 794us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687788.406878:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:1.0:1788687788.416147:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.416307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819682944 00000100:00100000:2.0:1788687788.416317:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819682944 00000100:00100000:2.0:1788687788.416383:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:2.0:1788687788.416394:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+30:10313:x1875574819682944:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788687788.416696:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+31:10313:x1875574819682944:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 302us (559us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788687788.416704:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:1.0:1788687788.463407:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687788.463533:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819683200 00000100:00100000:0.0:1788687788.463545:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819683200 00000100:00100000:0.0:1788687788.463597:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:0.0:1788687788.463607:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+31:10316:x1875574819683200:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687788.463630:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687788.463651:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e744490ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462bc1 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.463728:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.463746:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.463783:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.463802:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744490fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.463810:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744490fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.463817:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744490fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.463941:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.463950:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.463958:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687788.463968:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788687788.464082:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464090:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464097:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464103:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eda00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687788.464114:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464123:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464136:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687788.464139:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687788.464143:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464150:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744490f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464165:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744490fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464171:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744490fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464176:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744490fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464181:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eca00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687788.464184:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744490fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464189:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744490fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464196:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3d2736d00) 00010000:00010000:0.0:1788687788.464198:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687788.464405:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744490fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464411:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744490fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464457:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e744490ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc1 expref: 34 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464473:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc1 expref: 33 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.464538:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:0.0:1788687788.464541:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788687788.464543:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec600, rc 0) 00000100:00100000:0.0:1788687788.464637:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+33:10316:x1875574819683200:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1031us (1242us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788687788.464646:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:3.0:1788687788.469196:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687788.469817:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819683328 00000100:00100000:1.0:1788687788.469828:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819683328 00000100:00100000:1.0:1788687788.469979:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:1.0:1788687788.469990:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+33:10316:x1875574819683328:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:1.0:1788687788.470077:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.470095:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.470108:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.470137:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.470145:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449111 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.470153:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.470158:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687788.470178:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.470186:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449111 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.470200:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:1.0:1788687788.470203:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788687788.470207:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449111 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.470214:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449111 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687788.470303:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+33:10316:x1875574819683328:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 314us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687788.470310:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:3.0:1788687788.474050:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.474168:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819683584 00000100:00100000:2.0:1788687788.474178:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819683584 00000100:00100000:2.0:1788687788.474235:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:2.0:1788687788.474244:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+33:10316:x1875574819683584:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788687788.474463:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:10316:x1875574819683584:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 219us (424us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788687788.474567:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00010000:00010000:2.0:1788687788.549840:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687788.613924:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788687788.613951:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839638272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687788.614026:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687788.614182:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839638272 00000100:00100000:3.0:1788687788.614191:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839638272 00000100:00100000:3.0:1788687788.614245:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788687788.614254:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839638272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788687788.614285:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687788.614333:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839638272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687788.614340:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788687788.614711:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839638272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687788.719642:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.719796:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819683840 00000100:00100000:2.0:1788687788.719807:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819683840 00000100:00100000:2.0:1788687788.719874:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:2.0:1788687788.719885:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:10347:x1875574819683840:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:2.0:1788687788.719907:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687788.719930:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449118 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462bc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.720076:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444911f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.720094:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444911f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.720107:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444911f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687788.720118:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788687788.720262:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449118 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc8 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.720285:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444911f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc8 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.720293:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:2.0:1788687788.720296:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687788.720299:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3a00, rc 0) 00000100:00100000:2.0:1788687788.720364:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:10347:x1875574819683840:12345-192.168.204.26@tcp:101:cat.0 Request processed in 482us (733us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788687788.720372:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:3.0:1788687788.725256:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.725900:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819684096 00000100:00100000:2.0:1788687788.725912:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819684096 00000100:00100000:2.0:1788687788.725979:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:2.0:1788687788.725989:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:10347:x1875574819684096:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:2.0:1788687788.726367:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+37:10347:x1875574819684096:12345-192.168.204.26@tcp:35:cat.0 Request processed in 378us (1118us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788687788.726381:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:3.0:1788687788.734808:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.735004:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819684224 00000100:00100000:2.0:1788687788.735015:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819684224 00000100:00100000:2.0:1788687788.735092:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:2.0:1788687788.735102:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c6908c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+37:2348:x1875574819684224:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687788.735117:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687788.735142:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444911f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc8 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.735166:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:2.0:1788687788.735171:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687788.735234:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c6908c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:2348:x1875574819684224:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 132us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687788.735242:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:3.0:1788687788.785325:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.785526:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819684480 00000100:00100000:2.0:1788687788.785537:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819684480 00000100:00100000:2.0:1788687788.785609:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:2.0:1788687788.785618:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:10353:x1875574819684480:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1788687788.785640:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687788.785643:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788687788.785674:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e74449085 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b9e expref: 36 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.785700:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:2.0:1788687788.785705:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788687788.785718:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444912d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462bcf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.785834:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.785848:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc1 expref: 36 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.785856:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.785885:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc1 expref: 36 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.785897:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc1 expref: 36 pid: 8462 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687788.785909:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8836680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839638400:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687788.786002:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c57a6900 going to sleep for 11 seconds 00000100:00100000:2.0:1788687788.788170:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8836680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839638400:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687788.788200:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687788.788896:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687788.789001:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819684608 00000100:00100000:0.0:1788687788.789009:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819684608 00010000:00010000:0.0:1788687788.789068:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc1 expref: 37 pid: 8462 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687788.789108:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:0.0:1788687788.789119:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+37:2349:x1875574819684608:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687788.789147:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687788.789155:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc1 expref: 37 pid: 8462 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.789166:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc1 expref: 37 pid: 8462 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.789187:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449103 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bc1 expref: 37 pid: 8462 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.789583:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:0.0:1788687788.789588:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.789601:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.789610:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687788.789635:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687788.789700:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:2349:x1875574819684608:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 582us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687788.789708:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00010000:00010000:2.0:1788687788.790281:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.790292:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687788.790318:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788687788.790565:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444912d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bcf expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.790585:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bcf expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.790592:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:2.0:1788687788.790594:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788687788.790596:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3c00, rc 0) 00000100:00100000:2.0:1788687788.790715:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:10353:x1875574819684480:12345-192.168.204.26@tcp:101:dd.0 Request processed in 5097us (5400us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788687788.790723:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:3.0:1788687788.794456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687788.794688:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819684864 00000100:00100000:2.0:1788687788.794697:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819684864 00000100:00100000:2.0:1788687788.794749:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:2.0:1788687788.794758:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:10353:x1875574819684864:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:2.0:1788687788.795414:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.795435:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687788.795447:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788687788.795753:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788687788.796241:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096270a83 reply state 000000000edbc348 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687788.796253:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788687788.796448:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+39:10353:x1875574819684864:12345-192.168.204.26@tcp:36:dd.0 Request processed in 1687us (1996us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788687788.796456:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000020:00080000:2.0:1788687788.796461:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788687788.804749:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.804767:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.804775:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.804780:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687788.804784:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.804792:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.804833:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:1.0:1788687788.804836:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687788.804841:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687788.804848:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449142 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687789.162303:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687789.162640:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819684992 00000100:00100000:1.0:1788687789.162651:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819684992 00000100:00100000:1.0:1788687789.162716:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:1.0:1788687789.162726:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:10367:x1875574819684992:12345-192.168.204.26@tcp:101:stat.0 00010000:00010000:1.0:1788687789.162750:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687789.162774:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449149 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.162840:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449150 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.162855:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449150 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.162867:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449150 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.162884:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449157 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.162891:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.162917:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.163010:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.163034:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bcf expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.163050:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.163086:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bcf expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.163100:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bcf expref: 39 pid: 5841 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687789.163114:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b15180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839638528:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687789.163333:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687789.171596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.171683:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819685248 00000100:00100000:0.0:1788687789.171694:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819685248 00000100:00100000:0.0:1788687789.171758:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788687789.171769:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+40:5584:x1875574819685248:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788687789.172167:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:5584:x1875574819685248:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 389us (572us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788687789.172175:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:1.0:1788687789.172395:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b15180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839638528:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687789.172419:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687789.178109:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687789.179167:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819685376 00000100:00100000:2.0:1788687789.179179:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819685376 00010000:00010000:2.0:1788687789.179236:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bcf expref: 41 pid: 5841 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687789.179278:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:2.0:1788687789.179287:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:2349:x1875574819685376:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687789.179301:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687789.179308:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bcf expref: 41 pid: 5841 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.179322:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bcf expref: 41 pid: 5841 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.179344:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449134 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bcf expref: 41 pid: 5841 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.179364:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:2.0:1788687789.179369:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.179379:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.179387:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.179434:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687789.179531:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+40:2349:x1875574819685376:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 245us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687789.179539:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00010000:00010000:0.0:1788687789.180149:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180160:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687789.180215:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788687789.180219:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687789.180260:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180274:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180284:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449150 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180291:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449150 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180299:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449150 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180304:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687789.180309:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449150 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180316:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449150 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180336:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687789.180339:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687789.180343:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449150 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180350:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449150 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180363:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180370:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449157 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180376:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449157 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180382:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687789.180386:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449157 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180392:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449157 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180398:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3c7fb4e00) 00010000:00010000:0.0:1788687789.180400:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687789.180403:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449157 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180408:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449157 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180454:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449149 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bd6 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180469:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bd6 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.180477:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:0.0:1788687789.180531:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788687789.180534:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc200, rc 0) 00000100:00100000:0.0:1788687789.180603:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+39:10367:x1875574819684992:12345-192.168.204.26@tcp:101:stat.0 Request processed in 17879us (18311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687789.180611:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:3.0:1788687789.259661:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.259743:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819685632 00000100:00100000:0.0:1788687789.259756:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819685632 00000100:00100000:0.0:1788687789.259848:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:0.0:1788687789.259859:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+39:10373:x1875574819685632:12345-192.168.204.26@tcp:36:truncate.0 00010000:00010000:0.0:1788687789.259925:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687789.259955:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444915e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bd6 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.259977:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:0.0:1788687789.259982:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788687789.260244:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.260259:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.260287:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788687789.260345:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788687789.260372:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005419714d reply state 0000000098d6b471 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687789.260382:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788687789.260560:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:10373:x1875574819685632:12345-192.168.204.26@tcp:36:truncate.0 Request processed in 701us (909us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788687789.260569:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 54 00000020:00080000:0.0:1788687789.260574:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788687789.264028:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.264056:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.264065:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.264070:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687789.264076:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.264085:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.264103:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:2.0:1788687789.264106:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687789.264111:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.264117:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449165 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687789.426818:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687789.429705:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819685760 00000100:00100000:2.0:1788687789.429724:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819685760 00000100:00100000:2.0:1788687789.429843:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:2.0:1788687789.429859:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+40:10387:x1875574819685760:12345-192.168.204.26@tcp:101:stat.0 00010000:00010000:2.0:1788687789.429906:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687789.429931:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444916c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462bdd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.430298:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449173 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.430315:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449173 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.430328:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449173 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.430342:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444917a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.430349:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444917a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.430356:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444917a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.430545:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.430554:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.430561:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687789.433264:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788687789.433270:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687789.433304:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433323:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433335:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449173 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433342:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449173 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433350:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449173 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433356:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3a00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687789.433361:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449173 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433369:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449173 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433515:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:2.0:1788687789.433519:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687789.433526:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449173 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433533:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449173 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433575:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444917a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433581:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444917a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433587:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444917a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433592:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687789.433596:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444917a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433602:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444917a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433611:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3e29fe400) 00010000:00010000:2.0:1788687789.433613:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687789.433616:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444917a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433622:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444917a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433670:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444916c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bdd expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433687:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bdd expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.433706:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:2.0:1788687789.433708:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687789.433711:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2e00, rc 0) 00000100:00100000:2.0:1788687789.433801:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:10387:x1875574819685760:12345-192.168.204.26@tcp:101:stat.0 Request processed in 3946us (6996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687789.433810:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:3.0:1788687789.542419:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.544415:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819686016 00000100:00100000:0.0:1788687789.544431:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819686016 00000100:00100000:0.0:1788687789.544651:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:0.0:1788687789.544662:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:10397:x1875574819686016:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687789.544684:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687789.544708:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462be4 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687789.544801:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788687789.544926:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449188 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462be4 expref: 43 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.544943:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:0.0:1788687789.544946:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788687789.544952:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462be4 expref: 43 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.544991:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ede00, rc 0) 00000100:00100000:0.0:1788687789.545081:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+42:10397:x1875574819686016:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 420us (2672us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788687789.545089:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:3.0:1788687789.550905:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.551028:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819686272 00000100:00100000:0.0:1788687789.551048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819686272 00000100:00100000:0.0:1788687789.551112:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:0.0:1788687789.551123:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+42:10397:x1875574819686272:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788687789.551360:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+43:10397:x1875574819686272:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 238us (467us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788687789.551367:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00010000:00010000:3.0:1788687789.574177:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687789.638749:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.638816:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819686528 00000100:00100000:0.0:1788687789.638828:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819686528 00000100:00100000:0.0:1788687789.638899:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:0.0:1788687789.638910:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+43:10403:x1875574819686528:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788687789.638934:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687789.638956:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449196 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462beb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.639097:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.639112:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bdd expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.639133:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.639168:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bdd expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.639182:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bdd expref: 44 pid: 5841 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687789.639196:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839638656:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687789.639298:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d0171840 going to sleep for 11 seconds 00000100:00100000:3.0:1788687789.645043:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.645043:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839638656:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687789.645072:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687789.645234:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819686656 00000100:00100000:1.0:1788687789.645242:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819686656 00010000:00010000:1.0:1788687789.645284:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bdd expref: 45 pid: 5841 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687789.645346:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:1.0:1788687789.645356:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+45:2348:x1875574819686656:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687789.645376:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687789.645383:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bdd expref: 45 pid: 5841 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.645395:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bdd expref: 45 pid: 5841 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.645421:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e74449181 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bdd expref: 45 pid: 5841 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.645447:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:1.0:1788687789.645452:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.645461:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.645469:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.645551:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788687789.645594:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.645604:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687789.645623:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:1.0:1788687789.645667:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+44:2348:x1875574819686656:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 310us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687789.645675:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00010000:00010000:2.0:1788687789.645788:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449196 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462beb expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.645805:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462beb expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.645813:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:2.0:1788687789.645815:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788687789.645818:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79eca00, rc 0) 00000100:00100000:2.0:1788687789.645843:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+44:10403:x1875574819686528:12345-192.168.204.26@tcp:101:bash.0 Request processed in 6935us (7106us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788687789.645850:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:3.0:1788687789.650238:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.650299:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819686912 00000100:00100000:0.0:1788687789.650309:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819686912 00000100:00100000:0.0:1788687789.650419:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:0.0:1788687789.650430:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+44:10403:x1875574819686912:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:0.0:1788687789.650743:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.650762:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.650774:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788687789.650868:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788687789.650898:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8a6b020 reply state 000000002380f9ea transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687789.650906:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788687789.650999:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:10403:x1875574819686912:12345-192.168.204.26@tcp:36:bash.0 Request processed in 570us (771us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788687789.651006:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00000020:00080000:0.0:1788687789.651011:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788687789.654444:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.654475:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.654506:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.654512:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eda00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687789.654517:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.654524:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.654958:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:1.0:1788687789.654963:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687789.654968:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687789.654976:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744491ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687789.660162:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687789.660298:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819687040 00000100:00100000:2.0:1788687789.660316:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819687040 00000100:00100000:2.0:1788687789.660423:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:2.0:1788687789.660435:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+46:10403:x1875574819687040:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788687789.660470:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687789.660523:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744491b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462bf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.660619:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.660634:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462beb expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.660642:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.660689:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462beb expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.660704:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462beb expref: 47 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687789.660719:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8836680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839638784:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687789.660800:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c11ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1788687789.665207:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.665755:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819687168 00000100:00100000:0.0:1788687789.665765:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819687168 00000100:00100000:2.0:1788687789.665906:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8836680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839638784:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687789.665945:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.665976:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462beb expref: 48 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687789.666017:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:0.0:1788687789.666028:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+48:2348:x1875574819687168:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687789.666077:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687789.666086:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462beb expref: 48 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.666098:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462beb expref: 48 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.666122:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444919d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462beb expref: 48 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.666139:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:0.0:1788687789.666150:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.666160:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.666167:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.666196:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788687789.666225:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.666238:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687789.666256:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:2348:x1875574819687168:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 230us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687789.666263:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00000004:00200000:2.0:1788687789.666281:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788687789.666285:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687789.666313:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.666344:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744491b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bf2 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.666362:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bf2 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.666368:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:2.0:1788687789.666371:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687789.666373:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3600, rc 0) 00000100:00100000:2.0:1788687789.666399:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+46:10403:x1875574819687040:12345-192.168.204.26@tcp:101:bash.0 Request processed in 5968us (6247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687789.666405:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:3.0:1788687789.671302:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687789.671381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819687424 00000100:00100000:2.0:1788687789.671391:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819687424 00000100:00100000:2.0:1788687789.671513:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:2.0:1788687789.671524:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b94c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+46:10403:x1875574819687424:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:2.0:1788687789.672241:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b94c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:10403:x1875574819687424:12345-192.168.204.26@tcp:35:bash.0 Request processed in 717us (946us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788687789.672250:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:3.0:1788687789.754818:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687789.755387:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819687680 00000100:00100000:2.0:1788687789.755399:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819687680 00000100:00100000:2.0:1788687789.755801:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:2.0:1788687789.755817:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:10413:x1875574819687680:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687789.755861:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687789.755884:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744491c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462bf9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687789.755985:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788687789.756133:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744491c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bf9 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.756149:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:2.0:1788687789.756152:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788687789.756157:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744491c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bf9 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.756187:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3c00, rc 0) 00000100:00100000:2.0:1788687789.756258:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+48:10413:x1875574819687680:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 446us (1451us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788687789.756265:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:3.0:1788687789.764333:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.764509:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819687808 00000100:00100000:0.0:1788687789.764519:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819687808 00000100:00100000:0.0:1788687789.764575:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:0.0:1788687789.764585:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+48:10413:x1875574819687808:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:0.0:1788687789.764664:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764682:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764693:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764709:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764716:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764745:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764843:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764852:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764859:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788687789.764904:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764932:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764939:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764945:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764951:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eca00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687789.764955:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764961:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764974:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687789.764982:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687789.764987:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.764994:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765009:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765015:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765020:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765027:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79edc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687789.765030:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765045:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765053:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3d2736d00) 00010000:00010000:0.0:1788687789.765056:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687789.765058:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765064:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765080:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765092:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765097:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765102:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687789.765105:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765110:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765118:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:0.0:1788687789.765120:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687789.765123:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.765128:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687789.765207:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+48:10413:x1875574819687808:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 622us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687789.765215:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:3.0:1788687789.768195:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.768279:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819688064 00000100:00100000:0.0:1788687789.768288:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819688064 00000100:00100000:0.0:1788687789.768403:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:0.0:1788687789.768414:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+48:10413:x1875574819688064:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788687789.768673:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+49:10413:x1875574819688064:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 260us (485us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788687789.768694:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788687789.815894:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.815996:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819688320 00000100:00100000:0.0:1788687789.816006:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819688320 00000100:00100000:0.0:1788687789.816074:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1788687789.816084:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+49:10416:x1875574819688320:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687789.816109:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687789.816129:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c00 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816200:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816215:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816225:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816238:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816245:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816251:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816355:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e744491f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816379:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e744491f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816386:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e744491f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687789.816397:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788687789.816523:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816530:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816537:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816543:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79edc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687789.816547:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816554:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816565:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687789.816568:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687789.816572:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816578:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e744491ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816590:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816601:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816607:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816611:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eca00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687789.816614:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816620:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816627:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3d2736d00) 00010000:00010000:0.0:1788687789.816629:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687789.816631:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816637:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e744491f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816675:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744491e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c00 expref: 52 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816688:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e744491f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c00 expref: 51 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.816695:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:0.0:1788687789.816698:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788687789.816704:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed600, rc 0) 00000100:00100000:0.0:1788687789.816819:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:10416:x1875574819688320:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 736us (934us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788687789.816828:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:3.0:1788687789.822297:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687789.822400:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687789.822498:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819688576 00000100:00100000:2.0:1788687789.822508:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819688576 00000100:00100000:2.0:1788687789.822571:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:2.0:1788687789.822582:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:10416:x1875574819688576:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:2.0:1788687789.822649:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449206 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.822677:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.822689:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.822717:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.822723:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449206 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.822729:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.822735:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687789.822739:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.822745:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449206 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.822755:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:2.0:1788687789.822758:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788687789.822762:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449206 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687789.822769:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449206 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687789.822857:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:10416:x1875574819688576:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 277us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687789.822872:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:0.0:1788687789.825670:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819688448 00000100:00100000:0.0:1788687789.825683:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819688448 00000100:00100000:3.0:1788687789.825757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.825796:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:0.0:1788687789.825807:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:2349:x1875574819688448:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687789.825820:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687789.825845:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e744491f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c00 expref: 51 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.825862:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:0.0:1788687789.825866:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687789.825917:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+50:2349:x1875574819688448:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 113us (3630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687789.825925:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:2.0:1788687789.825969:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819688832 00000100:00100000:2.0:1788687789.825987:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819688832 00000100:00100000:2.0:1788687789.826040:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:2.0:1788687789.826049:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+50:10416:x1875574819688832:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788687789.826263:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:10416:x1875574819688832:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 215us (511us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788687789.826270:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:3.0:1788687789.984874:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687789.985013:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819689088 00000100:00100000:0.0:1788687789.985024:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819689088 00000100:00100000:0.0:1788687789.985102:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1788687789.985118:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:10434:x1875574819689088:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:0.0:1788687789.985147:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687789.985170:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444920d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c07 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.985287:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449214 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.985323:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449214 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.985336:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449214 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687789.985350:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788687789.985666:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444920d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c07 expref: 54 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.985690:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449214 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c07 expref: 53 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687789.985699:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:0.0:1788687789.985701:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788687789.985705:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed800, rc 0) 00000100:00100000:0.0:1788687789.985788:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:10434:x1875574819689088:12345-192.168.204.26@tcp:101:cat.0 Request processed in 672us (934us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788687789.985796:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:3.0:1788687790.025205:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687790.026860:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819689216 00000100:00100000:2.0:1788687790.026878:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819689216 00000100:00100000:2.0:1788687790.027019:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:2.0:1788687790.027046:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:10435:x1875574819689216:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687790.027080:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687790.027111:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c0e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.027202:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449229 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.027229:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.027242:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687790.027404:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788687790.027410:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687790.027432:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.027519:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c0e expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.027905:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c0e expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.027917:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:2.0:1788687790.027920:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687790.027924:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3a00, rc 0) 00000100:00100000:2.0:1788687790.028001:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:10435:x1875574819689216:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 974us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687790.028010:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00080000:0.0:1788687790.030161:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687790.033575:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687790.033795:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819689600 00000100:00100000:2.0:1788687790.033808:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819689600 00000100:00100000:2.0:1788687790.033886:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:2.0:1788687790.033898:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:10435:x1875574819689600:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788687790.034390:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10435:x1875574819689600:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 492us (828us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788687790.034400:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:3.0:1788687790.038771:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687790.039124:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819689728 00000100:00100000:1.0:1788687790.039138:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819689728 00000100:00100000:1.0:1788687790.039219:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:1.0:1788687790.039231:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10435:x1875574819689728:12345-192.168.204.26@tcp:103:lfs.0 00010000:00010000:1.0:1788687790.039250:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788687790.039423:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744491b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bf2 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687790.039868:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449214 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c07 expref: 54 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687790.039888:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744490c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462bb3 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687790.039902:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3c7fb4d00) 00010000:00010000:1.0:1788687790.039917:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687790.040016:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:10435:x1875574819689728:12345-192.168.204.26@tcp:103:lfs.0 Request processed in 786us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687790.040039:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:3.0:1788687790.043050:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687790.045042:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819689856 00000100:00100000:0.0:1788687790.045066:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819689856 00000100:00100000:0.0:1788687790.045158:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:0.0:1788687790.045172:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:10435:x1875574819689856:12345-192.168.204.26@tcp:58:lfs.0 00010000:00010000:0.0:1788687790.045361:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449230 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.045385:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449230 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.045407:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449230 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788687790.045846:0:8462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788687790.046133:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788687790.046216:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788687790.046389:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:10435:x1875574819689856:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 1215us (3358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687790.046408:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:0.0:1788687790.058897:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687790.058954:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687790.058996:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687790.059101:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819690240 00000100:00100000:2.0:1788687790.059114:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819690240 00000100:00080000:2.0:1788687790.059176:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687790.059248:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 132 00000100:00100000:2.0:1788687790.059271:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819690240:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687790.059390:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819690240:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 132us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687790.059417:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 132 00000100:00100000:3.0:1788687790.060404:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819689984 00000100:00100000:3.0:1788687790.060414:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819689984 00000100:00100000:3.0:1788687790.060468:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 286 00000100:00100000:3.0:1788687790.060512:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819689984:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687790.060585:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819689984:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 108us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687790.060593:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 286 00000100:00100000:1.0:1788687790.061161:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819690112 00000100:00100000:1.0:1788687790.061170:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819690112 00000100:00100000:1.0:1788687790.061243:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:1.0:1788687790.061253:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2346:x1875574819690112:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687790.061381:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2346:x1875574819690112:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 130us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687790.061389:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00080000:0.0:1788687790.061646:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687790.062815:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687790.063147:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819690368 00000100:00100000:0.0:1788687790.063157:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819690368 00000100:00100000:0.0:1788687790.063257:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:0.0:1788687790.063341:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:10437:x1875574819690368:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687790.063368:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687790.063398:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449237 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c15 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063535:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444923e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063562:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444923e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063577:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444923e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063616:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063625:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063633:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063758:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063767:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063774:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687790.063825:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788687790.063830:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687790.063853:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063868:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063878:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444923e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063886:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444923e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063907:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444923e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063913:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687790.063918:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444923e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063926:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444923e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063940:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687790.063943:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687790.063947:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444923e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063954:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444923e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063972:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063978:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449245 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063984:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.063989:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ece00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687790.063992:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.064009:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449245 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.064018:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3d2736400) 00010000:00010000:0.0:1788687790.064020:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687790.064024:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449245 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.064187:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449245 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.064232:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449237 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c15 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.064249:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c15 expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687790.064258:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687790.064261:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687790.064403:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed000, rc 0) 00000100:00100000:0.0:1788687790.064995:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:10437:x1875574819690368:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1655us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687790.065006:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00010000:00010000:2.0:1788687790.598116:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788687790.779631:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:0.0:1788687790.779679:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788687790.780139:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839638912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788687790.780236:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788687790.780676:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9af3d0171cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788687790.780682:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3c8bacf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9af3d01719c0 00000020:00080000:0.0:1788687790.780696:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3c8bac900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9af3c1219800 00000001:00080000:0.0:1788687790.780742:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:0.0:1788687790.780798:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788687790.780955:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788687790.781331:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839638912 00000100:00100000:2.0:1788687790.781418:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839638912 00000100:00080000:0.0:1788687790.781605:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687790.781713:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788687790.781726:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875574839638912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788687790.781773:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788687790.781825:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9d35ab, atime: 0x6a9d35ab, ctime: 0x6a9d35ab, blocks: 0x1 00010000:00010000:2.0:1788687790.781837:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000280caa08/0xc2ddd83e74449253 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.781857:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1788687790.781862:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687790.781870:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000280caa08/0xc2ddd83e74449253 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.781890:0:6687:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000280caa08/0xc2ddd83e74449253 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.781902:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000280caa08/0xc2ddd83e74449253 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.781911:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000280caa08/0xc2ddd83e74449253 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687790.781980:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788687790.782816:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875574839638912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1090us (2576us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788687790.782826:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1788687790.783049:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3ee90aa00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788687790.783057:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839638912:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788687790.783226:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687790.783238:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000280caa08/0xc2ddd83e74449253 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687790.783253:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687790.783259:0:5827:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000280caa08/0xc2ddd83e74449253 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687790.783282:0:5827:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000280caa08/0xc2ddd83e74449253 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687790.783308:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000280caa08/0xc2ddd83e74449253 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687790.783317:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000280caa08/0xc2ddd83e74449253 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687790.783415:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687790.783418:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687790.783420:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788687790.825921:0:12001:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788687790.825942:0:12001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788687790.826045:0:12001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788687790.826055:0:12001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788687790.982387:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788687790.982398:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788687790.982454:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788687790.982474:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788687790.982643:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839639040:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788687790.982760:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d0171180 going to sleep for 11 seconds 00000100:00100000:0.0:1788687790.988916:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839639040:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788687791.001946:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.006858:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819690496 00000100:00100000:3.0:1788687791.006873:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819690496 00000100:00100000:3.0:1788687791.007737:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:3.0:1788687791.007752:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:10449:x1875574819690496:12345-192.168.204.26@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788687791.007851:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:10449:x1875574819690496:12345-192.168.204.26@tcp:900:lhsmtool_posix.0 Request processed in 103us (5918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687791.007860:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:1.0:1788687791.019107:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687791.019187:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819690624 00000100:00100000:2.0:1788687791.019198:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819690624 00000100:00100000:2.0:1788687791.019261:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:2.0:1788687791.019273:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:10449:x1875574819690624:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788687791.019314:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788687791.019447:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:10449:x1875574819690624:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 176us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687791.019454:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:1.0:1788687791.023569:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.023653:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819690752 00000100:00100000:3.0:1788687791.023663:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819690752 00000100:00100000:3.0:1788687791.023747:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1788687791.023758:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:10449:x1875574819690752:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788687791.023838:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444925a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.023855:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444925a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.023868:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444925a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.023925:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449261 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.023933:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449261 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.023939:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449261 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.023965:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.023972:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.023978:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687791.024028:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788687791.024032:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687791.024050:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024070:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444925a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024076:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444925a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024083:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444925a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024089:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687791.024094:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444925a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024102:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444925a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024116:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:3.0:1788687791.024129:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687791.024133:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444925a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024140:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444925a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024154:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449261 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024160:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449261 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024166:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449261 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024177:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aacc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687791.024180:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449261 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024186:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449261 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024193:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9af3ca87ce00) 00010000:00010000:3.0:1788687791.024195:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687791.024198:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449261 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024203:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449261 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024218:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024223:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024228:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024232:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687791.024234:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024239:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024260:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687791.024263:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687791.024266:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.024271:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449268 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687791.024354:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:10449:x1875574819690752:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 596us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687791.024365:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:0.0:1788687791.041240:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687791.042415:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819691008 00000100:00100000:2.0:1788687791.042432:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819691008 00000100:00100000:2.0:1788687791.043114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:2.0:1788687791.043127:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:10449:x1875574819691008:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788687791.043154:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687791.043177:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e7444926f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c1c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.043278:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.043312:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.043325:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687791.043338:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788687791.044254:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.044268:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449276 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.044275:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.044541:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687791.044546:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.044556:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449276 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.044570:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:2.0:1788687791.044573:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687791.044577:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449276 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.044583:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.044635:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e7444926f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c1c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.044659:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:2.0:1788687791.044662:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788687791.044667:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e7444926f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c1c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.044677:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3000, rc 0) 00000100:00100000:2.0:1788687791.044752:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:10449:x1875574819691008:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1627us (3519us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788687791.044761:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:2.0:1788687791.058688:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.058771:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819691136 00000100:00100000:3.0:1788687791.058786:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819691136 00000100:00100000:3.0:1788687791.058854:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:3.0:1788687791.058867:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:10449:x1875574819691136:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788687791.058982:0:8462:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788687791.059141:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:10449:x1875574819691136:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 276us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687791.059148:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:2.0:1788687791.064811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687791.066071:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819691392 00000100:00100000:1.0:1788687791.066086:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819691392 00000100:00100000:1.0:1788687791.066226:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:1.0:1788687791.066237:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:10449:x1875574819691392:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687791.066258:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687791.066266:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788687791.066292:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e74449229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c0e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.066410:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:1.0:1788687791.066416:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687791.066430:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449284 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788687791.067585:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788687791.068327:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e7444928b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.068347:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e7444928b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.068359:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e7444928b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.068426:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449284 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c23 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.068444:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e7444928b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c23 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.068454:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3c7fb4e00) 00010000:00010000:1.0:1788687791.068457:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687791.068460:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cda00, rc 0) 00000100:00100000:1.0:1788687791.069354:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10449:x1875574819691392:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 3113us (4546us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788687791.069383:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:2.0:1788687791.074147:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.074362:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819691648 00000100:00100000:3.0:1788687791.074381:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819691648 00000100:00100000:1.0:1788687791.074565:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:1.0:1788687791.074589:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10449:x1875574819691648:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788687791.074659:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687791.074691:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e7444928b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c23 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.074710:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3c7fb4e00) 00010000:00010000:1.0:1788687791.074721:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687791.074746:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449299 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.074759:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449299 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.074770:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449299 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.074786:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xec2846bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.074793:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec2846bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.074800:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec2846bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.075039:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449299 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.075058:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449299 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.075063:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449299 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.075070:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687791.075075:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449299 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.075082:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449299 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.075091:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:1.0:1788687791.075093:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687791.075097:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449299 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.075102:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449299 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.075111:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec2846bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.076079:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec2846bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.076091:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec2846bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.076097:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cde00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687791.076113:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec2846bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.076225:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec2846bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.076238:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xec2846bd (ffff9af3c7fb4d00) 00010000:00010000:1.0:1788687791.076241:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687791.076244:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xec2846bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.076250:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xec2846bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687791.076453:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:10449:x1875574819691648:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 1871us (2310us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788687791.076462:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:0.0:1788687791.079538:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.079617:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819691776 00000100:00100000:3.0:1788687791.079636:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819691776 00000100:00100000:3.0:1788687791.079722:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:3.0:1788687791.079737:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:10449:x1875574819691776:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687791.079765:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687791.079796:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744492a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c2a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.079868:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.079884:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.079898:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.080034:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744492a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c2a expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.080058:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c2a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.080068:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:3.0:1788687791.080072:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788687791.080076:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aacc00, rc 0) 00000100:00100000:3.0:1788687791.080184:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10449:x1875574819691776:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 451us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687791.080193:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:3.0:1788687791.085103:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687791.085194:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819692032 00000100:00100000:2.0:1788687791.085213:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819692032 00000100:00100000:2.0:1788687791.085295:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:2.0:1788687791.085306:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10449:x1875574819692032:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788687791.085413:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.085432:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.085449:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788687791.086307:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788687791.086321:0:8462:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336776839241ns, next at 337776836337ns, rc = 0 00000004:00010000:2.0:1788687791.088388:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008646dc7f reply state 00000000d6f573eb transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687791.088695:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788687791.088946:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:10449:x1875574819692032:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 3637us (3855us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788687791.088956:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:3.0:1788687791.096874:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:2.0:1788687791.097194:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687791.097211:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819692160 00010000:00010000:2.0:1788687791.097214:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.097222:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687791.097224:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819692160 00010000:00010000:2.0:1788687791.097229:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687791.097233:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.097241:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.097259:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:2.0:1788687791.097262:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788687791.097267:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.097273:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744492b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687791.097299:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:1.0:1788687791.097310:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:10449:x1875574819692160:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687791.097340:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687791.097365:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.097422:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c31 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.097435:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c31 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.097474:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:1.0:1788687791.097476:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687791.097517:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cde00, rc 0) 00000100:00100000:1.0:1788687791.097578:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:10449:x1875574819692160:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 270us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687791.097585:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:0.0:1788687791.105431:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687791.105601:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819692288 00000100:00100000:1.0:1788687791.105613:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819692288 00000100:00100000:1.0:1788687791.105662:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:1.0:1788687791.105671:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875574819692288:12345-192.168.204.26@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788687791.105702:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:1.0:1788687791.105733:0:6689:0:(genops.c:1385:class_connect()) connect: client bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f, cookie 0xc2ddd83e744492c3 00002000:00100000:1.0:1788687791.105754:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f/ffff9af3d2b02800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788687791.105779:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788687791.106025:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788687791.106058:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9af3c882f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687791.106134:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2345:x1875574819692288:12345-192.168.204.26@tcp:8:lhsmtool_posix.0 Request processed in 463us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687791.106142:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:0.0:1788687791.109894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.110211:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819692416 00000100:00100000:3.0:1788687791.110222:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819692416 00000100:00100000:3.0:1788687791.110304:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:3.0:1788687791.110315:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:0:x1875574819692416:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788687791.110720:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788687791.153384:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000001:00080000:0.0:1788687791.153405:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788687791.153706:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:0:x1875574819692416:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 43385us (43817us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788687791.153718:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:2.0:1788687791.157272:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687791.157361:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819692672 00000100:00100000:0.0:1788687791.157370:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819692672 00000100:00100000:0.0:1788687791.157428:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:0.0:1788687791.157447:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:10449:x1875574819692672:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788687791.157728:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:10449:x1875574819692672:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 281us (465us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788687791.157746:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:2.0:1788687791.160830:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687791.160934:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819692928 00000100:00100000:0.0:1788687791.160945:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819692928 00000100:00100000:0.0:1788687791.161020:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:0.0:1788687791.161031:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:10449:x1875574819692928:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788687791.161144:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:10449:x1875574819692928:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 114us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687791.161152:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:1.0:1788687791.164584:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.164666:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819693056 00000100:00100000:3.0:1788687791.164676:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819693056 00000100:00100000:3.0:1788687791.164735:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:3.0:1788687791.164746:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:10449:x1875574819693056:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687791.164767:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687791.164787:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744492ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c38 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.164854:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744492d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.164869:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744492d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.164881:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744492d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687791.164937:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687791.164957:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744492d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.164982:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744492ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c38 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.164999:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744492d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c38 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.165035:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:3.0:1788687791.165038:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788687791.165041:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aade00, rc 0) 00000100:00100000:3.0:1788687791.165106:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:10449:x1875574819693056:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 360us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687791.165113:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:3.0:1788687791.168478:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687791.168709:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819693184 00000100:00100000:1.0:1788687791.168721:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819693184 00000100:00100000:1.0:1788687791.168803:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:1.0:1788687791.168814:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819693184:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687791.168847:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687791.168871:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e744492d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c3f expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687791.168897:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d35ae, blocks: 0x1 00010000:00010000:1.0:1788687791.168986:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1788687791.168991:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687791.169002:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e744492d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c3f expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.169033:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e744492d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c3f expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.169046:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cda00, rc 0) 00000100:00100000:1.0:1788687791.169110:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819693184:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 298us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687791.169117:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:2.0:1788687791.172025:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687791.172174:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819693440 00000100:00100000:0.0:1788687791.172184:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819693440 00000100:00100000:0.0:1788687791.172243:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:0.0:1788687791.172253:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:10449:x1875574819693440:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788687791.172367:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:10449:x1875574819693440:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 115us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687791.172375:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:0.0:1788687791.176092:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687791.176241:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819693568 00000100:00100000:2.0:1788687791.176251:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819693568 00000100:00100000:2.0:1788687791.176315:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:2.0:1788687791.176325:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:10449:x1875574819693568:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788687791.176343:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687791.176361:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c46 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.176400:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e744492d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c3f expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.176409:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687791.176415:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687791.176421:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.176468:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e744492d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c3f expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.176692:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e744492d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c3f expref: 7 pid: 6689 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687791.176709:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c82e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875574839639168:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687791.177231:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8db3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788687791.180311:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c82e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875574839639168:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687791.180358:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.180381:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3200, rc 0) 00000100:00100000:0.0:1788687791.180452:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:10449:x1875574819693568:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 4127us (4368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687791.180461:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:1.0:1788687791.183873:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.184000:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819693696 00000100:00100000:3.0:1788687791.184019:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819693696 00010000:00010000:3.0:1788687791.184066:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e744492d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c3f expref: 7 pid: 6689 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687791.184117:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:3.0:1788687791.184128:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c6909850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819693696:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687791.184144:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687791.184171:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e744492d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c3f expref: 7 pid: 6689 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.184187:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e744492d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c3f expref: 7 pid: 6689 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.184213:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e744492d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c3f expref: 7 pid: 6689 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.184253:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687791.184258:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687791.184268:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.184277:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.184323:0:7632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687791.184339:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee909c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7632:1875574839639296:192.168.204.26@tcp:105: 00000100:00100000:3.0:1788687791.184433:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788687791.187965:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee909c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7632:1875574839639296:192.168.204.26@tcp:105: 00010000:00010000:3.0:1788687791.188000:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687791.188091:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c6909850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819693696:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 3963us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687791.188101:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:2.0:1788687791.191394:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687791.191708:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819693824 00000100:00100000:0.0:1788687791.191719:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819693824 00002000:00100000:0.0:1788687791.191772:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9af3c82e7b80 x1875574819693824/t0(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:692/0 lens 504/0 e 0 to 0 dl 1788687802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788687791.191783:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c82e7b80 with x1875574819693824 ext(0->8) 00002000:00010000:0.0:1788687791.191790:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3c82e7b80 00000100:00100000:0.0:1788687791.191824:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788687791.191835:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819693824:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788687791.193127:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2348:x1875574819693824:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 Request processed in 1288us (1736us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788687791.193139:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00002000:00100000:0.0:1788687791.193149:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9af3c82e7b80 x1875574819693824/t4294967302(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:692/0 lens 504/448 e 0 to 0 dl 1788687802 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788687791.193158:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c82e7b80 with x1875574819693824 ext(0->8) 00002000:00010000:0.0:1788687791.193162:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3c82e7b80 00000100:00100000:1.0:1788687791.197215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.197669:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819693952 00000100:00100000:3.0:1788687791.197682:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819693952 00000100:00100000:3.0:1788687791.197754:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:3.0:1788687791.197765:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:10449:x1875574819693952:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788687791.242722:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1788687791.242740:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:0.0:1788687791.242763:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788687791.242830:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788687791.242841:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788687791.243074:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10449:x1875574819693952:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 45304us (45862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687791.243086:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:1.0:1788687791.243122:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687791.243138:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839639424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788687791.243197:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687791.245995:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839639424 00000100:00100000:3.0:1788687791.246021:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839639424 00000100:00080000:2.0:1788687791.246094:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788687791.246123:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788687791.246133:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839639424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788687791.246392:0:8309:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788687791.246396:0:8309:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788687790 00002000:00010000:3.0:1788687791.246399:0:8309:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788687791.246400:0:8309:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788687790 -> 1788687790 00002000:00010000:3.0:1788687791.246402:0:8309:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788687791.246523:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875574839639424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 391us (3324us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788687791.246531:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788687791.246713:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3ee90bb80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788687791.246720:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839639424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788687791.247350:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687791.247382:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819694080 00000100:00100000:1.0:1788687791.247388:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819694080 00000100:00100000:1.0:1788687791.247620:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:1.0:1788687791.247633:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2347:x1875574819694080:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788687791.277405:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1788687791.277803:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1788687791.278082:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819694080:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 30445us (30728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687791.278154:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:2.0:1788687791.281749:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687791.281872:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819694336 00000100:00100000:0.0:1788687791.281885:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819694336 00000100:00100000:0.0:1788687791.282272:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:0.0:1788687791.282284:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10449:x1875574819694336:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788687791.282355:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687791.282394:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744492d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c38 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.282414:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:0.0:1788687791.282419:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788687791.282451:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.282466:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.282476:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788687791.283336:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c85495b reply state 00000000b7c080a4 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687791.283346:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788687791.283470:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:10449:x1875574819694336:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 1186us (1729us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788687791.283478:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 81 00010000:00010000:2.0:1788687791.290940:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.290963:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.290973:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.290980:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ece00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687791.290987:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.290996:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.291034:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:2.0:1788687791.291038:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687791.291044:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.291051:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e744492e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687791.292522:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.293140:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819694464 00000100:00100000:3.0:1788687791.293156:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819694464 00000100:00100000:3.0:1788687791.293244:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:3.0:1788687791.293257:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819694464:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788687791.299801:0:8309:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788687791.299815:0:8309:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788687790 -> 1788687789 00002000:00010000:2.0:1788687791.299820:0:8309:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788687787 00002000:00010000:2.0:1788687791.299823:0:8309:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788687790 -> 1788687789 00002000:00010000:2.0:1788687791.299825:0:8309:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788687791.299933:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819694464:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 6670us (7451us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788687791.299946:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:1.0:1788687791.306202:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687791.306323:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819694720 00000100:00100000:2.0:1788687791.306337:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819694720 00000100:00100000:2.0:1788687791.306460:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:2.0:1788687791.306473:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10449:x1875574819694720:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788687791.306620:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.306641:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c2a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.306653:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.306703:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c2a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.306720:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c2a expref: 13 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687791.306738:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c3119500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839639552:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687791.306896:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8db3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788687791.312257:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c3119500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839639552:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687791.312293:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687791.319374:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687791.319637:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819694848 00000100:00100000:0.0:1788687791.319650:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819694848 00010000:00010000:0.0:1788687791.319716:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c2a expref: 14 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687791.319768:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:0.0:1788687791.319780:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:2349:x1875574819694848:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687791.319800:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687791.319809:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c2a expref: 14 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.319842:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c2a expref: 14 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.319873:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e744492ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c2a expref: 14 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.319895:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:0.0:1788687791.319902:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.319925:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.319936:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.319980:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687791.320060:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:2349:x1875574819694848:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 282us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687791.320069:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00010000:00010000:2.0:1788687791.320428:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.320439:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.320613:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.320624:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.320632:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.320639:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3a00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687791.320644:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.320655:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.320667:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:2.0:1788687791.320670:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788687791.320675:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.320698:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744492ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687791.320761:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:10449:x1875574819694720:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 Request processed in 14290us (14574us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788687791.320770:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:1.0:1788687791.324667:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687791.324768:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819694976 00000100:00100000:0.0:1788687791.324783:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819694976 00000100:00100000:0.0:1788687791.324999:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:0.0:1788687791.325024:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819694976:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788687791.325094:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.325144:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.325154:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788687791.325159:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788687791.325165:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.325229:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.325245:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 7 pid: 6687 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687791.325264:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875574839639680:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687791.325598:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d0171600 going to sleep for 11 seconds 00000100:00100000:0.0:1788687791.328414:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875574839639680:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687791.328466:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687791.336271:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687791.336574:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819695104 00000100:00100000:0.0:1788687791.336591:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819695104 00010000:00010000:0.0:1788687791.336653:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 8 pid: 6687 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687791.336729:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:0.0:1788687791.336741:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819695104:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687791.336761:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687791.336791:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 8 pid: 6687 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.336807:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 8 pid: 6687 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.336849:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2607efe/0xc2ddd83e744492df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c46 expref: 8 pid: 6687 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.336873:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788687791.336878:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788687791.336886:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.336898:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.337450:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687791.337611:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819695104:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 869us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687791.337621:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00010000:00010000:2.0:1788687791.339549:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.339573:0:6687:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.339623:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.339633:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.339643:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.339651:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79edc00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687791.339657:0:6687:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.339669:0:6687:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.339720:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.339730:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e744492f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687791.339937:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819694976:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 14911us (15280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687791.339949:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:1.0:1788687791.344794:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687791.344938:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819695360 00000100:00100000:0.0:1788687791.344951:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819695360 00000100:00100000:0.0:1788687791.345038:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:0.0:1788687791.345051:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:10449:x1875574819695360:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788687791.345172:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744492fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.345194:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744492fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.345209:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744492fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.345797:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.345814:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c31 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.345825:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.346019:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c31 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.346037:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c31 expref: 13 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687791.346054:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839639808:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687791.346174:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d0171600 going to sleep for 11 seconds 00000100:00100000:2.0:1788687791.350295:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687791.350409:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819695488 00000100:00100000:1.0:1788687791.350421:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819695488 00010000:00010000:1.0:1788687791.350523:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492bc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c31 expref: 14 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687791.350578:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:1.0:1788687791.350590:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3119500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:2348:x1875574819695488:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687791.350610:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687791.350619:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492bc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c31 expref: 14 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.350636:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c31 expref: 14 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.350666:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:1.0:1788687791.350673:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.350707:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.350715:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.350739:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687791.350966:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3119500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:2348:x1875574819695488:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 377us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687791.350974:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00010000:00010000:0.0:1788687791.352125:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e744492bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c31 expref: 13 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687791.352158:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839639808:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687791.352201:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.352214:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.352221:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788687791.354194:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788687791.354429:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788687791.354518:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788687791.354645:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5840:1875574839639936:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788687791.354749:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687791.354794:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d01713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687791.354919:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839639936 00000100:00100000:2.0:1788687791.354930:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839639936 00000100:00100000:2.0:1788687791.355014:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788687791.355026:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875574839639936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788687791.355146:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875574839639936:12345-0@lo:1000:mdt00_001.0 Request processed in 122us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687791.355154:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788687791.355401:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788687791.355408:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3ee90bb80, transno 4294967303 00000100:00100000:0.0:1788687791.355436:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5840:1875574839639936:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788687791.357767:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788687791.359095:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5840:1875574839640064:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788687791.359194:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687791.359244:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d0171600 going to sleep for 11 seconds 00000100:00100000:2.0:1788687791.359536:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839640064 00000100:00100000:2.0:1788687791.359549:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839640064 00000100:00100000:2.0:1788687791.359720:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788687791.359737:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875574839640064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788687791.360138:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875574839640064:12345-0@lo:1000:mdt00_001.0 Request processed in 405us (943us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788687791.360148:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788687791.360464:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5840:1875574839640064:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788687791.360671:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.360701:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.360709:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.360716:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687791.360721:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.360731:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.360751:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:0.0:1788687791.360754:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788687791.360761:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.360768:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449302 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.361079:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449230 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.361087:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449230 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.361094:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449230 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.361098:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eca00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687791.361110:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449230 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.361116:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449230 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.361126:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687791.361129:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788687791.361133:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449230 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.361139:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449230 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.361272:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.361291:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c15 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.361302:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.361363:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c15 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687791.361380:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c15 expref: 16 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687791.361395:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839640192:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687791.361686:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788687791.369910:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839640192:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687791.369982:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687791.370291:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687791.370395:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819695616 00000100:00100000:3.0:1788687791.370414:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819695616 00010000:00010000:3.0:1788687791.370475:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c15 expref: 17 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687791.370550:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:3.0:1788687791.370561:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3119180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:2348:x1875574819695616:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687791.370580:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687791.370646:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c15 expref: 17 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.370675:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c15 expref: 17 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.370698:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e7444924c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c15 expref: 17 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.370716:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687791.370722:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.370734:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.370743:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687791.370782:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687791.370931:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3119180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:2348:x1875574819695616:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 369us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687791.370944:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00010000:00010000:2.0:1788687791.370951:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.370964:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.370983:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.370990:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.370998:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371014:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687791.371020:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371030:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371046:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:2.0:1788687791.371050:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687791.371054:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371061:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449309 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371079:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744492fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371099:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744492fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371106:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744492fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371111:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687791.371115:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744492fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371122:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744492fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371132:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:2.0:1788687791.371134:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788687791.371137:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744492fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.371143:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e744492fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687791.371653:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:10449:x1875574819695360:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 26600us (26877us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788687791.371667:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 83 00000020:00080000:2.0:1788687791.371674:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788687791.372181:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687791.372188:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687791.372220:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788687791.372228:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788687791.376437:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687791.376748:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819695872 00000100:00100000:0.0:1788687791.376761:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819695872 00000100:00100000:0.0:1788687791.376847:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:0.0:1788687791.376860:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:10449:x1875574819695872:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788687791.383329:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788687791.383999:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788687791.384125:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.384151:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.384166:0:5842:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.384176:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.384198:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.384205:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687791.384236:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687791.384468:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687791.384510:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.384530:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eca00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687791.384536:0:5828:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.384544:0:5828:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.384558:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9af3d2736e00) 00010000:00010000:2.0:1788687791.384561:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788687791.384566:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.384571:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e74449310 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687791.384592:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687791.384594:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687791.384596:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687791.384660:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:10449:x1875574819695872:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 7794us (8231us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788687791.384673:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000020:00080000:0.0:1788687791.384681:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788687791.624901:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687792.652743:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788687792.692767:0:12055:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687792.692781:0:12055:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687792.692824:0:12055:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788687792.692831:0:12055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788687792.808697:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687792.808963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819696128 00000100:00100000:0.0:1788687792.808993:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819696128 00000100:00080000:2.0:1788687792.809053:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687792.809090:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:0.0:1788687792.809104:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:10467:x1875574819696128:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687792.809138:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687792.809167:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449317 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c4d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.809308:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444931e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.809327:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444931e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.809341:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444931e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687792.809365:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788687792.809799:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449317 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c4d expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.809818:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444931e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c4d expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.809828:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687792.809831:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788687792.809835:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec400, rc 0) 00000100:00100000:0.0:1788687792.809921:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:10467:x1875574819696128:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 821us (1240us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788687792.809930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:3.0:1788687792.813297:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687792.813458:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819696256 00000100:00100000:2.0:1788687792.813651:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819696256 00000100:00100000:2.0:1788687792.813753:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:2.0:1788687792.813765:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:10467:x1875574819696256:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:2.0:1788687792.813864:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444932c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.813884:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444932c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.813919:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444932c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.813937:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74449333 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.813944:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74449333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.813950:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74449333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814287:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814295:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814302:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788687792.814354:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814371:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444932c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814378:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444932c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814385:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444932c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814414:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687792.814420:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444932c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814429:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444932c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814444:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:2.0:1788687792.814447:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687792.814453:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444932c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814459:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444932c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814506:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74449333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814513:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74449333 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814518:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74449333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814524:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687792.814527:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74449333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814533:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74449333 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814617:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3e29fe100) 00010000:00010000:2.0:1788687792.814620:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687792.814623:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74449333 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814629:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e74449333 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814646:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814652:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814658:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814662:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2e00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687792.814665:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814671:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814677:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:2.0:1788687792.814679:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687792.814682:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.814686:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444933a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687792.814814:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:10467:x1875574819696256:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 1049us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687792.814825:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:2.0:1788687792.842107:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687792.842170:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819696512 00000100:00100000:3.0:1788687792.842184:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819696512 00000100:00100000:3.0:1788687792.842266:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:3.0:1788687792.842291:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:10470:x1875574819696512:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687792.842320:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687792.842357:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449341 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c54 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.842462:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449348 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.842784:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449348 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.842866:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449348 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.843005:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444934f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.843015:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444934f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.843024:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444934f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.843394:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.843404:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.843411:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687792.843423:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788687792.843752:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449348 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.843773:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449348 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.843782:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449348 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.843788:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687792.843794:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449348 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.843880:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449348 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845595:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:3.0:1788687792.845601:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687792.845684:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449348 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845695:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449348 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845719:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444934f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845726:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444934f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845733:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444934f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845739:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687792.845759:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444934f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845768:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444934f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845777:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3ca87c500) 00010000:00010000:3.0:1788687792.845780:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687792.845784:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444934f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845790:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444934f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845952:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c54 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845969:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c54 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.845988:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:3.0:1788687792.845991:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687792.845994:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad600, rc 0) 00000100:00100000:3.0:1788687792.846101:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:10470:x1875574819696512:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 3813us (4009us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788687792.846111:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:0.0:1788687792.852472:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687792.852547:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819696640 00000100:00100000:3.0:1788687792.852563:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819696640 00000100:00100000:3.0:1788687792.852736:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:3.0:1788687792.852751:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:10470:x1875574819696640:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788687792.852858:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.852879:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.852894:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.853196:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.853207:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449364 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.853216:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.853224:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aacc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687792.853231:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.853241:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449364 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.853259:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:3.0:1788687792.853263:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788687792.853269:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449364 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.853276:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687792.853411:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:10470:x1875574819696640:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 653us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687792.853421:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:0.0:1788687792.858849:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687792.859129:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819696896 00000100:00100000:3.0:1788687792.859143:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819696896 00000100:00100000:3.0:1788687792.859249:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:3.0:1788687792.859263:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b95850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:10470:x1875574819696896:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:3.0:1788687792.859622:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b95850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:10470:x1875574819696896:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 362us (786us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788687792.859631:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:2.0:1788687792.908702:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687792.908755:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819697152 00000100:00100000:2.0:1788687792.908768:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819697152 00000100:00100000:2.0:1788687792.908848:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:2.0:1788687792.908860:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:9991:x1875574819697152:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788687792.908898:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687792.908928:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444936b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c5b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.909090:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.909110:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c54 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.909121:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.909174:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c54 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687792.909192:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c54 expref: 23 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687792.909239:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c311aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839640320:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687792.909372:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8db3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687792.912627:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687792.912665:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819697280 00000100:00100000:3.0:1788687792.912677:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819697280 00010000:00010000:3.0:1788687792.912732:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c54 expref: 24 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687792.912778:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:3.0:1788687792.912790:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:2349:x1875574819697280:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687792.912810:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687792.912819:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c54 expref: 24 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.912835:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c54 expref: 24 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.912887:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:3.0:1788687792.912894:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.912906:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.912915:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.912939:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687792.913014:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:2349:x1875574819697280:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 225us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687792.913022:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00010000:00010000:3.0:1788687792.913232:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c54 expref: 23 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687792.913247:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c311aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839640320:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687792.913274:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.913285:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.913290:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687792.913314:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788687792.913663:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444936b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c5b expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.913691:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c5b expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.913700:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:3.0:1788687792.913704:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788687792.913707:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2000, rc 0) 00000100:00100000:3.0:1788687792.913758:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:9991:x1875574819697152:12345-192.168.204.26@tcp:101:bash.0 Request processed in 4900us (5072us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788687792.913767:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:3.0:1788687792.925204:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687792.925253:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819697536 00000100:00100000:3.0:1788687792.925265:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819697536 00000100:00100000:3.0:1788687792.925331:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:3.0:1788687792.925342:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:9991:x1875574819697536:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:3.0:1788687792.925740:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.925762:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687792.925775:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788687792.925836:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788687792.925863:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b33e27a8 reply state 00000000730ff91e transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687792.925895:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788687792.925947:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788687792.926085:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:9991:x1875574819697536:12345-192.168.204.26@tcp:36:bash.0 Request processed in 742us (895us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788687792.926094:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 89 00000020:00080000:3.0:1788687792.926100:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788687792.929330:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:0.0:1788687792.929650:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.929666:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.929674:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.929681:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687792.929688:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.929721:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.929744:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:0.0:1788687792.929747:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687792.929753:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.929761:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449380 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687792.929873:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819697664 00000100:00100000:1.0:1788687792.929886:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819697664 00000100:00100000:1.0:1788687792.930005:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:1.0:1788687792.930019:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:9991:x1875574819697664:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788687792.930048:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687792.930071:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449387 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687792.930145:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c62 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687792.930159:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c62 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687792.930179:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:1.0:1788687792.930182:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687792.930184:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cda00, rc 0) 00000100:00100000:1.0:1788687792.930278:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:9991:x1875574819697664:12345-192.168.204.26@tcp:101:bash.0 Request processed in 262us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687792.930285:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:3.0:1788687792.937071:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687792.937361:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819697792 00000100:00100000:0.0:1788687792.937375:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819697792 00000100:00100000:0.0:1788687792.938111:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:0.0:1788687792.938127:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:9991:x1875574819697792:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788687792.938155:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687792.938185:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444938e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788687792.938221:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9d35ad, atime: 0x6a9d35ab, ctime: 0x6a9d35ad, blocks: 0xb 00010000:00010000:0.0:1788687792.938251:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1788687792.938257:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687792.938268:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444938e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c69 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.938291:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444938e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c69 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687792.938322:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed800, rc 0) 00000100:00100000:0.0:1788687792.938411:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:9991:x1875574819697792:12345-192.168.204.26@tcp:101:bash.0 Request processed in 289us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687792.938419:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:0.0:1788687792.941532:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687792.941635:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819697920 00000100:00100000:2.0:1788687792.941651:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819697920 00002000:00010000:2.0:1788687792.941712:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788687792.941719:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c2e8a680 with x1875574819697920 ext(0->18446744073709551615) 00002000:00010000:2.0:1788687792.941736:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3c2e8a680. 00000100:00100000:2.0:1788687792.941770:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:2.0:1788687792.941781:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819697920:12345-192.168.204.26@tcp:10:bash.0 00002000:00010000:2.0:1788687792.942166:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788687792.942170:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788687789 -> 1788687792 00002000:00010000:2.0:1788687792.942174:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788687787 -> 1788687787 00002000:00010000:2.0:1788687792.942176:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788687789 -> 1788687792 00002000:00010000:2.0:1788687792.942179:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788687792.942263:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819697920:12345-192.168.204.26@tcp:10:bash.0 Request processed in 482us (859us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788687792.942273:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00002000:00010000:2.0:1788687792.942277:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788687792.942280:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c2e8a680 with x1875574819697920 ext(0->18446744073709551615) 00002000:00010000:2.0:1788687792.942285:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3c2e8a680. 00000100:00100000:1.0:1788687793.010057:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.010161:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819698048 00000100:00100000:3.0:1788687793.010176:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819698048 00000100:00100000:3.0:1788687793.010266:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:3.0:1788687793.010279:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:10484:x1875574819698048:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:3.0:1788687793.010389:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449395 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010412:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010428:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010448:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444939c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010456:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444939c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010463:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444939c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010857:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010883:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010892:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788687793.010950:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010964:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010984:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449395 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.010993:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449395 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011000:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687793.011005:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449395 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011019:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449395 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011033:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:3.0:1788687793.011037:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687793.011042:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449395 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011055:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449395 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011072:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444939c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011079:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444939c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011089:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444939c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011094:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aacc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687793.011097:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444939c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011104:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444939c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011112:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3ca87c500) 00010000:00010000:3.0:1788687793.011114:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687793.011117:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444939c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011123:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444939c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011143:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011149:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011166:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011172:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687793.011175:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011182:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011191:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:3.0:1788687793.011193:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687793.011196:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.011202:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687793.011442:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:10484:x1875574819698048:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 1161us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687793.011454:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:3.0:1788687793.041240:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.041409:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819698304 00000100:00100000:2.0:1788687793.041444:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819698304 00000100:00100000:2.0:1788687793.041866:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:2.0:1788687793.041880:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:10487:x1875574819698304:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687793.041908:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687793.041938:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744493aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c70 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.042674:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.042696:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.042710:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.042728:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744493b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.042801:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744493b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.042809:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744493b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.043244:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e744493bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.043255:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e744493bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.043263:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e744493bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687793.043362:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788687793.046147:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046171:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046180:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046187:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687793.046193:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046203:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046226:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:2.0:1788687793.046229:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687793.046235:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046242:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046277:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744493b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046284:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744493b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046314:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744493b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046319:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687793.046322:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744493b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046329:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744493b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046338:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3e29fe600) 00010000:00010000:2.0:1788687793.046341:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687793.046344:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744493b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046350:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744493b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046430:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744493aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c70 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046449:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e744493bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c70 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.046456:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:2.0:1788687793.046459:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788687793.046462:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3e00, rc 0) 00000100:00100000:2.0:1788687793.046618:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:10487:x1875574819698304:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 4739us (5394us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788687793.046638:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:0.0:1788687793.053197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.053534:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819698432 00000100:00100000:3.0:1788687793.053550:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819698432 00000100:00100000:3.0:1788687793.053627:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:3.0:1788687793.053638:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:10487:x1875574819698432:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788687793.053708:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.053725:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c5b expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.053754:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.053804:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c5b expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.053819:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c5b expref: 29 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.053843:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee908380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839640448:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687793.053960:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687793.057102:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee908380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839640448:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687793.057239:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.059020:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.059219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819698688 00000100:00100000:2.0:1788687793.059228:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819698688 00000100:00100000:2.0:1788687793.059291:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:2.0:1788687793.059301:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+30:9241:x1875574819698688:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788687793.060118:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+31:9241:x1875574819698688:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 814us (1100us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788687793.060129:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:1.0:1788687793.064768:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687793.064913:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819698816 00000100:00100000:0.0:1788687793.064922:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819698816 00010000:00010000:0.0:1788687793.064960:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c5b expref: 31 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.065012:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:0.0:1788687793.065020:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+31:2348:x1875574819698816:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687793.065031:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687793.065037:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c5b expref: 31 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.065046:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c5b expref: 31 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.065067:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449372 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c5b expref: 31 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.065085:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:0.0:1788687793.065104:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.065118:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.065127:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.065212:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687793.065224:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.065232:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.065262:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.065270:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.065275:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+30:2348:x1875574819698816:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 255us (579us total) trans 0 rc 0/0 00010000:00010000:1.0:1788687793.065277:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.065283:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc20324f0) 00000100:00100000:0.0:1788687793.065283:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 48 00010000:00010000:1.0:1788687793.065288:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.065295:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.065304:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:1.0:1788687793.065307:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788687793.065310:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.065328:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744493cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687793.065368:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:10487:x1875574819698432:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 11732us (12188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687793.065376:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:0.0:1788687793.069246:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.069342:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819699072 00000100:00100000:3.0:1788687793.069354:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819699072 00000100:00100000:3.0:1788687793.069409:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788687793.069419:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:10487:x1875574819699072:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:3.0:1788687793.069689:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+30:10487:x1875574819699072:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 271us (453us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788687793.069697:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788687793.133005:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.133056:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687793.133181:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819699328 00000100:00100000:0.0:1788687793.133191:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819699328 00000100:00100000:0.0:1788687793.133261:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:0.0:1788687793.133273:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2348:x1875574819699328:12345-192.168.204.26@tcp:16:kworker.0 00000100:00100000:2.0:1788687793.137102:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819699200 00000100:00100000:2.0:1788687793.137118:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819699200 00002000:00100000:0.0:1788687793.138944:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9af3ee90ad80 x1875574819699200/t0(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:694/0 lens 496/0 e 0 to 0 dl 1788687804 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788687793.138960:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3ee90ad80 with x1875574819699200 ext(0->7) 00002000:00010000:0.0:1788687793.138976:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3ee90ad80 00000100:00100000:0.0:1788687793.139014:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:0.0:1788687793.139026:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2348:x1875574819699200:12345-192.168.204.26@tcp:4:bash.0 00000100:00100000:0.0:1788687793.140248:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:2348:x1875574819699200:12345-192.168.204.26@tcp:4:bash.0 Request processed in 709us (6673us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788687793.140260:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00002000:00100000:0.0:1788687793.140432:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9af3ee90ad80 x1875574819699200/t4294967307(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:694/0 lens 496/448 e 0 to 0 dl 1788687804 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788687793.140442:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3ee90ad80 with x1875574819699200 ext(0->7) 00002000:00010000:0.0:1788687793.140447:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3ee90ad80 00000100:00080000:2.0:1788687793.140539:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687793.174900:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687793.180227:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819699584 00000100:00100000:1.0:1788687793.180246:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819699584 00000100:00100000:1.0:1788687793.180320:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:1.0:1788687793.180335:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+30:10498:x1875574819699584:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:1.0:1788687793.180362:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687793.180385:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744493d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c77 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180458:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744493db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180473:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744493db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180540:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744493db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180558:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e744493e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180566:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e744493e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180585:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e744493e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180828:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e744493e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180837:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e744493e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180845:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e744493e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687793.180857:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788687793.180982:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744493db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180991:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744493db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.180997:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744493db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181004:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687793.181009:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744493db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181016:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744493db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181029:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:1.0:1788687793.181033:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687793.181045:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744493db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181052:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744493db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181068:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e744493e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181075:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e744493e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181080:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e744493e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181086:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687793.181089:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e744493e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181095:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e744493e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181103:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3c7fb4f00) 00010000:00010000:1.0:1788687793.181106:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687793.181108:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e744493e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181114:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e744493e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181175:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744493d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c77 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181208:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e744493e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c77 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.181215:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:1.0:1788687793.181218:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687793.181221:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd600, rc 0) 00000100:00100000:1.0:1788687793.181300:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:10498:x1875574819699584:12345-192.168.204.26@tcp:101:cat.0 Request processed in 969us (6417us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788687793.181312:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:2.0:1788687793.188921:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.189019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819699840 00000100:00100000:3.0:1788687793.189044:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819699840 00000100:00100000:3.0:1788687793.189113:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:3.0:1788687793.189124:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:10498:x1875574819699840:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:3.0:1788687793.189432:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+33:10498:x1875574819699840:12345-192.168.204.26@tcp:35:cat.0 Request processed in 308us (524us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788687793.189441:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000001:00080000:0.0:1788687793.206747:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1788687793.206766:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1788687793.206961:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2348:x1875574819699328:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 73674us (73949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687793.206990:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:3.0:1788687793.224141:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839640576:0@lo:400:kworker.0 00000100:00100000:2.0:1788687793.224733:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.224778:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819700096 00000100:00100000:2.0:1788687793.224787:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819700096 00000100:00100000:2.0:1788687793.224854:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 95 00000100:00100000:2.0:1788687793.224866:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+33:10499:x1875574819700096:12345-192.168.204.26@tcp:36:rm.0 00000100:00100000:0.0:1788687793.225122:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839640960:0@lo:400:kworker.0 00000100:00100000:0.0:1788687793.225192:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788687793.225208:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788687793.225246:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e744493e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c77 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.225279:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e744493bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c70 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.225288:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839640960 00000100:00100000:0.0:1788687793.225293:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839640960 00010000:00010000:2.0:1788687793.225302:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449387 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c62 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.225328:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:2.0:1788687793.225347:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687793.225347:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788687793.225364:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687793.225364:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839640960:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1788687793.225377:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.225394:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.225406:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.225425:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.225432:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.225445:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839641088:0@lo:400:kworker.0 00000100:00100000:0.0:1788687793.225446:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839640960:12345-0@lo:400:kworker.0 Request processed in 89us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687793.225466:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788687793.225521:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788687793.225535:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788687793.225584:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839640704:0@lo:400:kworker.0 00000100:00100000:3.0:1788687793.225612:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788687793.225631:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.225642:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839641216:0@lo:400:kworker.0 00000100:00100000:3.0:1788687793.225694:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687793.226053:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839641088 00000100:00100000:1.0:1788687793.226060:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839641088 00010000:00010000:2.0:1788687793.226203:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449405 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.226214:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.226222:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788687793.227334:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788687793.227347:0:8462:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338917865898ns, next at 339917862134ns, rc = 0 00010000:00010000:2.0:1788687793.227617:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.227635:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.227646:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.227655:0:8462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.227661:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.227668:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687793.230283:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839640704 00000100:00100000:1.0:1788687793.230304:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839640704 00000100:00100000:1.0:1788687793.230336:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788687793.230350:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839641088:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1788687793.230537:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687793.231281:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231296:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449405 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231303:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449405 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231311:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687793.231317:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449405 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231327:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449405 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231367:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:2.0:1788687793.231370:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788687793.231376:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449405 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231383:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449405 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231415:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231422:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231428:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231445:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687793.231448:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231454:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231462:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:2.0:1788687793.231465:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687793.231468:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.231474:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744493f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788687793.231524:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cee000b5 reply state 00000000cdfe2962 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687793.231534:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788687793.231658:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839641216 00000100:00100000:0.0:1788687793.231675:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839641216 00000100:00100000:0.0:1788687793.231805:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788687793.231820:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839641216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687793.234112:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788687793.234136:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839640832:0@lo:400:kworker.0 00000100:00100000:1.0:1788687793.234150:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839641088:12345-0@lo:400:kworker.0 Request processed in 3792us (8621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687793.234170:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788687793.234221:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687793.234228:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788687793.234246:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c3118000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839641344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687793.234255:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839640704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687793.234286:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687793.234382:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839640704:12345-0@lo:400:kworker.0 Request processed in 142us (8768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687793.234404:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788687793.234419:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839640832 00000100:00100000:1.0:1788687793.234429:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839640832 00000100:00100000:2.0:1788687793.234793:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:10499:x1875574819700096:12345-192.168.204.26@tcp:36:rm.0 Request processed in 9925us (10063us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788687793.234803:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 95 00000100:00100000:1.0:1788687793.235159:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788687793.235168:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839640832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687793.235210:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839640832:12345-0@lo:400:kworker.0 Request processed in 44us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687793.235216:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788687793.235312:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839641088:0@lo:400:kworker.0 00010000:00010000:0.0:1788687793.235776:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687793.235799:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.235814:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687793.235819:0:5827:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.235851:0:5827:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.237108:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:0.0:1788687793.237112:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788687793.237119:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.237126:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444940c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.237173:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687793.237175:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687793.237179:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788687793.237199:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788687793.237208:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687793.237244:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839640576 00000100:00100000:3.0:1788687793.237255:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839640576 00000100:00100000:0.0:1788687793.237271:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839640960:0@lo:400:kworker.0 00000100:00100000:3.0:1788687793.237326:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788687793.237334:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3311:x1875574839640576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687793.237355:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839641216:12345-0@lo:400:kworker.0 Request processed in 5541us (11661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687793.237363:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788687793.238288:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839641344 00000100:00100000:0.0:1788687793.238294:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839641344 00000100:00100000:0.0:1788687793.238343:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788687793.238351:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839641344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788687793.238381:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687793.238622:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839640832:0@lo:400:kworker.0 00000100:00100000:2.0:1788687793.238637:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839640704:0@lo:400:kworker.0 00000100:00100000:2.0:1788687793.238646:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788687793.238652:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1788687793.238671:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839641216:0@lo:400:kworker.0 00000100:00100000:3.0:1788687793.240896:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3311:x1875574839640576:12345-0@lo:400:kworker.0 Request processed in 3553us (15535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.240931:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788687793.241064:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839641344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2712us (6777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687793.241073:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788687793.241140:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839640576:0@lo:400:kworker.0 00000100:00100000:0.0:1788687793.241152:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c3118000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839641344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788687793.241419:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.241432:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.241440:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.241447:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687793.241451:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.241459:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.241474:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3e29fe100) 00010000:00010000:3.0:1788687793.241642:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687793.241649:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.241657:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744493fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687793.303582:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687793.304413:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819700352 00000100:00100000:0.0:1788687793.304432:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819700352 00000100:00100000:0.0:1788687793.304562:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 96 00000100:00100000:0.0:1788687793.304577:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+31:10505:x1875574819700352:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788687793.304610:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687793.304639:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e74449413 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c7e expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.304802:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444941a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.304820:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444941a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.304833:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444941a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.304848:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.304855:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.304862:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788687793.305655:0:8462:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788687793.305922:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.305949:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.305959:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.306024:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444941a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.306032:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444941a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.306039:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444941a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.306046:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687793.306052:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444941a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.306062:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444941a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.306077:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687793.306080:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687793.306085:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444941a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.306092:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed200/0xc2ddd83e7444941a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788687793.306109:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a090614f reply state 00000000d5096690 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.306128:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788687793.306175:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e74449413 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c7e expref: 34 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.306200:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c7e expref: 33 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.306210:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:0.0:1788687793.306214:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788687793.306219:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec200, rc 0) 00000100:00100000:0.0:1788687793.306333:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:10505:x1875574819700352:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1760us (2761us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788687793.306344:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 96 00010000:00010000:3.0:1788687793.308870:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.308892:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.308908:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.308915:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ece00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687793.308921:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.308930:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.308951:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3d2736a00) 00010000:00010000:3.0:1788687793.308954:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687793.308960:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.308977:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e74449421 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.313321:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.313366:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819700480 00000100:00100000:3.0:1788687793.313378:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819700480 00000100:00100000:3.0:1788687793.313463:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:3.0:1788687793.313500:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2346:x1875574819700480:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788687793.313526:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687793.313554:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0a2d694/0xc2ddd83e74449436 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c85 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788687793.313593:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788687793.313618:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1788687793.313641:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687793.313654:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a2d694/0xc2ddd83e74449436 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c85 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.313678:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0a2d694/0xc2ddd83e74449436 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c85 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.313698:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aacc00, rc 0) 00000100:00100000:3.0:1788687793.313777:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2346:x1875574819700480:12345-192.168.204.26@tcp:101:bash.0 Request processed in 298us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.313789:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00080000:3.0:1788687793.313824:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687793.316688:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687793.318909:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819700608 00000001:00080000:3.0:1788687793.318930:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788687793.318935:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819700608 00000001:00080000:3.0:1788687793.318945:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1788687793.319196:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:1.0:1788687793.319210:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:10505:x1875574819700608:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788687793.319237:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687793.319265:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c8c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.320122:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0a2d694/0xc2ddd83e74449436 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c85 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.320136:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687793.320141:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687793.320148:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.320202:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0a2d694/0xc2ddd83e74449436 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c85 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.320244:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0a2d694/0xc2ddd83e74449436 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c85 expref: 7 pid: 6686 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687793.320267:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1875574839641472:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687793.320926:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788687793.323161:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1875574839641472:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687793.323212:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.323244:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc600, rc 0) 00000100:00100000:2.0:1788687793.323327:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:10505:x1875574819700608:12345-192.168.204.26@tcp:101:bash.0 Request processed in 4120us (6655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687793.323339:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:3.0:1788687793.326118:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.326229:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819700736 00000100:00100000:2.0:1788687793.326261:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819700736 00010000:00010000:2.0:1788687793.326320:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a2d694/0xc2ddd83e74449436 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c85 expref: 7 pid: 6686 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687793.326420:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:2.0:1788687793.326432:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c6909450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819700736:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687793.326470:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687793.326543:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0a2d694/0xc2ddd83e74449436 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c85 expref: 7 pid: 6686 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.326561:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0a2d694/0xc2ddd83e74449436 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c85 expref: 7 pid: 6686 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.326592:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0a2d694/0xc2ddd83e74449436 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c85 expref: 7 pid: 6686 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.326616:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687793.326621:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687793.326632:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.326644:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.326700:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687793.326733:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c3119880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1875574839641600:192.168.204.26@tcp:105: 00000100:00100000:2.0:1788687793.326835:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c7283540 going to sleep for 11 seconds 00000100:00100000:0.0:1788687793.330511:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.330591:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819700992 00000100:00100000:3.0:1788687793.330603:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819700992 00000100:00100000:3.0:1788687793.330676:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:3.0:1788687793.330689:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+33:10505:x1875574819700992:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:3.0:1788687793.331177:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:10505:x1875574819700992:12345-192.168.204.26@tcp:35:bash.0 Request processed in 490us (697us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788687793.331187:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:2.0:1788687793.336624:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c3119880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1875574839641600:192.168.204.26@tcp:105: 00010000:00010000:2.0:1788687793.336664:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687793.336763:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c6909450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819700736:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 10332us (10661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687793.336776:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 49 00000040:00080000:0.0:1788687793.413877:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788687793.413892:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788687793.413933:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788687793.413941:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788687793.469103:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687793.469720:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819701120 00000100:00100000:1.0:1788687793.469735:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819701120 00000100:00100000:2.0:1788687793.470746:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:2.0:1788687793.470767:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:10521:x1875574819701120:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687793.470809:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687793.470837:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74449444 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c93 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.470942:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e7444944b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.470972:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e7444944b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.470989:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e7444944b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687793.471039:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788687793.471043:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687793.471063:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e7444944b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.471117:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74449444 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c93 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.471181:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e7444944b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c93 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.471193:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:2.0:1788687793.471197:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687793.471201:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2800, rc 0) 00000100:00100000:2.0:1788687793.471313:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+35:10521:x1875574819701120:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 554us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687793.473065:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:0.0:1788687793.477551:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.479229:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819701376 00000100:00100000:2.0:1788687793.479251:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819701376 00000100:00100000:2.0:1788687793.479409:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 98 00000100:00100000:2.0:1788687793.479423:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+35:10521:x1875574819701376:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687793.479455:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687793.479501:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74449452 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462c9a expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.479662:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449459 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.479696:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.479712:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687793.479748:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788687793.479929:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74449452 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c9a expref: 38 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.479956:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449459 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c9a expref: 37 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.479978:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:2.0:1788687793.479981:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687793.479985:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3e00, rc 0) 00000100:00100000:2.0:1788687793.480117:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+37:10521:x1875574819701376:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 695us (2580us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788687793.480126:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 98 00000100:00100000:3.0:1788687793.489406:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.489473:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687793.489627:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819701632 00000100:00100000:1.0:1788687793.489640:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819701632 00000100:00100000:0.0:1788687793.489701:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819701760 00000100:00100000:0.0:1788687793.489709:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819701760 00000100:00100000:1.0:1788687793.489724:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 99 00000100:00100000:1.0:1788687793.489739:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:10521:x1875574819701632:12345-192.168.204.26@tcp:101:lfs.0 00000100:00100000:0.0:1788687793.489768:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00010000:00010000:1.0:1788687793.489770:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788687793.489780:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:2347:x1875574819701760:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687793.489799:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687793.489802:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449467 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ca1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.489829:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449459 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c9a expref: 39 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.489877:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:0.0:1788687793.489882:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687793.489934:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444946e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.489952:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:2347:x1875574819701760:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 174us (478us total) trans 0 rc 0/0 00010000:00010000:1.0:1788687793.489954:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444946e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.489979:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00010000:00010000:1.0:1788687793.489984:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444946e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687793.490000:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788687793.490170:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449467 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ca1 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.490202:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444946e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ca1 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.490210:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:1.0:1788687793.490213:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788687793.490216:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd400, rc 0) 00000100:00100000:1.0:1788687793.490253:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:10521:x1875574819701632:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 519us (874us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788687793.490260:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 99 00000100:00100000:3.0:1788687793.497328:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687793.498932:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819701888 00000100:00100000:0.0:1788687793.498954:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819701888 00000100:00100000:0.0:1788687793.499071:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:0.0:1788687793.499085:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fbad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819701888:12345-192.168.204.26@tcp:1:lfs.0 00010000:00010000:0.0:1788687793.499157:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.499185:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.499195:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687793.499201:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788687793.499206:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.499264:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.499284:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 6 pid: 6689 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.499331:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875574839641728:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687793.499522:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788687793.503635:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687793.503972:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819702016 00000100:00100000:1.0:1788687793.503986:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819702016 00002000:00100000:1.0:1788687793.504060:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9af3c830d500 x1875574819702016/t0(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:694/0 lens 504/0 e 0 to 0 dl 1788687804 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788687793.504075:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c830d500 with x1875574819702016 ext(0->8) 00010000:00010000:1.0:1788687793.504087:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 7 pid: 6689 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.504107:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 7 pid: 6689 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687793.504115:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9af3c830d500 00000100:00100000:1.0:1788687793.504157:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:1.0:1788687793.504170:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819702016:12345-192.168.204.26@tcp:4:lfs.0 00000100:00100000:1.0:1788687793.504875:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2348:x1875574819702016:12345-192.168.204.26@tcp:4:lfs.0 Request processed in 705us (1254us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788687793.504892:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00002000:00100000:1.0:1788687793.504900:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9af3c830d500 x1875574819702016/t4294967302(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:694/0 lens 504/448 e 0 to 0 dl 1788687804 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788687793.504910:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c830d500 with x1875574819702016 ext(0->8) 00010000:00010000:1.0:1788687793.504916:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 9 pid: 6689 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.504928:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 9 pid: 6689 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687793.504935:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9af3c830d500 00000100:00100000:3.0:1788687793.505149:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875574839641728:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687793.505198:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687793.509406:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.510471:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819702144 00000100:00100000:3.0:1788687793.510524:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819702144 00010000:00010000:3.0:1788687793.510601:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 9 pid: 6689 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687793.510705:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:2.0:1788687793.510725:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3119500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2346:x1875574819702144:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687793.510746:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788687793.510776:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788687793.510780:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788687792 00002000:00010000:2.0:1788687793.510783:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788687793 00002000:00010000:2.0:1788687793.510785:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788687792 00010000:00010000:2.0:1788687793.510794:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 9 pid: 6689 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.510811:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 9 pid: 6689 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.510864:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000022a35e3/0xc2ddd83e7444943d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c8c expref: 9 pid: 6689 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.510888:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788687793.510893:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788687793.510900:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.510912:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.510958:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687793.511046:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3119500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2346:x1875574819702144:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 327us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687793.511055:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00010000:00010000:3.0:1788687793.511136:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.511148:0:6686:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.511177:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.511187:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.511196:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.511203:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eca00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687793.511208:0:6686:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.511231:0:6686:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.511243:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.511251:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c04bf924/0xc2ddd83e7444947c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.511307:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fbad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819701888:12345-192.168.204.26@tcp:1:lfs.0 Request processed in 12226us (13997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.511317:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:0.0:1788687793.514946:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.515086:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819702400 00000100:00100000:3.0:1788687793.515099:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819702400 00000100:00100000:3.0:1788687793.515171:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:3.0:1788687793.515184:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b95450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:10521:x1875574819702400:12345-192.168.204.26@tcp:35:lfs.0 00000004:00010000:3.0:1788687793.515276:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444946e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ca1 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788687793.515705:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788687793.515742:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788687793.516199:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788687793.516264:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.516284:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c7e expref: 42 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.516303:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.516348:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c7e expref: 42 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.516366:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c7e expref: 42 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.516384:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba9ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1875574839641856:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687793.516544:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687793.519676:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba9ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1875574839641856:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687793.519720:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.520710:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.521196:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819702528 00000100:00100000:3.0:1788687793.521207:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819702528 00010000:00010000:3.0:1788687793.521261:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c7e expref: 43 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.521315:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:3.0:1788687793.521326:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+43:2348:x1875574819702528:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687793.521347:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687793.521356:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c7e expref: 43 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.521408:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c7e expref: 43 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.521441:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e74449428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c7e expref: 43 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.521476:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:3.0:1788687793.521788:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.521800:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.521808:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.521845:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788687793.521890:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.521902:0:5843:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.521922:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+42:2348:x1875574819702528:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 596us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.521931:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00000001:00080000:2.0:1788687793.522131:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788687793.522847:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788687793.523540:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c3119180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875574839641984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788687793.523642:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687793.523694:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c9ae6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687793.523701:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839641984 00000100:00100000:3.0:1788687793.523711:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839641984 00000100:00100000:3.0:1788687793.523774:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788687793.523785:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875574839641984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788687793.523899:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875574839641984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 116us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.523908:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788687793.524028:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788687793.524035:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788687793.524061:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3ee90aa00, transno 4294967301 00000100:00100000:0.0:1788687793.524083:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c3119180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875574839641984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788687793.524925:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788687793.525032:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875574839642112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788687793.525090:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687793.525131:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687793.525146:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839642112 00000100:00100000:2.0:1788687793.525162:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839642112 00000100:00100000:2.0:1788687793.525220:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788687793.525230:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875574839642112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788687793.528118:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875574839642112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 2874us (3012us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788687793.528138:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788687793.528143:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875574839642112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788687793.528275:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788687793.528356:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.528369:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.528378:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.528385:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687793.528640:0:5843:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.528671:0:5843:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.528692:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:0.0:1788687793.528696:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788687793.528702:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.528709:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449483 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788687793.529011:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788687793.529180:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788687793.529196:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339219714252ns, next at 340219710604ns, rc = 0 00000001:00080000:0.0:1788687793.529205:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788687793.529254:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:0.0:1788687793.529257:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788687793.529266:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444946e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ca1 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687793.530093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b95450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+45:10521:x1875574819702400:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 14905us (15155us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788687793.530107:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00000020:00080000:1.0:1788687793.530116:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788687793.533605:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.533850:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819702656 00000100:00100000:3.0:1788687793.533864:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819702656 00000100:00100000:3.0:1788687793.533942:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:3.0:1788687793.533956:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+45:10521:x1875574819702656:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687793.534001:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687793.534037:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444948a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ca8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.534122:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444948a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ca8 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.534141:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444948a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ca8 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.534163:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687793.534167:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788687793.534170:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac600, rc 0) 00000100:00100000:3.0:1788687793.534253:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+46:10521:x1875574819702656:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 301us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.534261:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:1.0:1788687793.541909:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687793.545732:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819702912 00000100:00100000:0.0:1788687793.545760:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819702912 00000100:00100000:1.0:1788687793.545997:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:1.0:1788687793.546014:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+46:10521:x1875574819702912:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788687793.546384:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:10521:x1875574819702912:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 373us (4491us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788687793.546393:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:2.0:1788687793.623099:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687793.623200:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819703040 00000100:00100000:1.0:1788687793.623212:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819703040 00000100:00100000:1.0:1788687793.623290:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:1.0:1788687793.623304:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:10531:x1875574819703040:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:1.0:1788687793.623444:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449491 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623476:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623522:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623542:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623550:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623558:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623685:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623694:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623701:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788687793.623754:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623770:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623787:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449491 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623794:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623801:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687793.623806:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623815:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449491 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623831:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:1.0:1788687793.623834:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687793.623839:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.623845:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.624770:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.624782:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449498 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.624790:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.624795:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687793.624810:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.624817:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449498 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.624830:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3c7fb4500) 00010000:00010000:1.0:1788687793.624833:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687793.624837:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449498 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.624971:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.624995:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.625001:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.625006:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.625011:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687793.625014:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.625019:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.625027:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:1.0:1788687793.625029:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687793.625039:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.625045:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444949f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687793.625312:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:10531:x1875574819703040:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 2007us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687793.625321:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:0.0:1788687793.668954:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.669091:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819703296 00000100:00100000:2.0:1788687793.669105:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819703296 00000100:00100000:2.0:1788687793.669185:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 102 00000100:00100000:2.0:1788687793.669197:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:10534:x1875574819703296:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687793.669225:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687793.669253:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744494a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462caf expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.669358:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744494ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.669377:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744494ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.669391:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744494ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.669411:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744494b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.669419:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744494b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.669451:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744494b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687793.669760:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687793.670012:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670022:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670029:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687793.670040:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788687793.670175:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744494ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670183:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744494ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670190:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744494ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670197:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687793.670203:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744494ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670213:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744494ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670226:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:2.0:1788687793.670230:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687793.670244:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744494ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670251:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744494ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670273:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744494b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670280:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744494b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670286:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744494b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670292:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687793.670295:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744494b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670306:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744494b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670315:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3e29fef00) 00010000:00010000:2.0:1788687793.670317:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687793.670320:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744494b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670326:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744494b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670727:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744494a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462caf expref: 50 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670758:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462caf expref: 49 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.670767:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:2.0:1788687793.670770:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687793.670773:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3a00, rc 0) 00000100:00100000:2.0:1788687793.670906:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+49:10534:x1875574819703296:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1711us (1967us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788687793.670916:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 102 00000100:00100000:3.0:1788687793.674384:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.674640:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819703424 00000100:00100000:2.0:1788687793.674655:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819703424 00000100:00100000:2.0:1788687793.674728:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:2.0:1788687793.674743:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+49:10534:x1875574819703424:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:2.0:1788687793.674845:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744494c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.674866:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744494c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.674879:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744494c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.674911:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744494c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.674920:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744494c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.674950:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744494c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.674966:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687793.674972:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744494c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.674982:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744494c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.674998:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:2.0:1788687793.675001:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788687793.675007:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744494c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.675014:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e744494c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687793.675169:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+49:10534:x1875574819703424:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 429us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687793.675178:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:3.0:1788687793.677992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687793.678100:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819703680 00000100:00100000:1.0:1788687793.678113:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819703680 00000100:00100000:1.0:1788687793.678217:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:1.0:1788687793.678229:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+49:10534:x1875574819703680:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788687793.678593:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+50:10534:x1875574819703680:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 365us (614us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788687793.678603:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:3.0:1788687793.733859:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788687793.733903:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839642240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687793.734021:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687793.734350:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839642240 00000100:00100000:1.0:1788687793.734363:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839642240 00000100:00100000:1.0:1788687793.734432:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788687793.734444:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839642240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687793.734474:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687793.734579:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839642240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687793.734588:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788687793.734775:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839642240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687793.746548:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.746712:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819703936 00000100:00100000:3.0:1788687793.746746:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819703936 00000100:00100000:3.0:1788687793.746835:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 104 00000100:00100000:3.0:1788687793.746849:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+50:10544:x1875574819703936:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788687793.746883:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687793.746888:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788687793.746927:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e7444944b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c93 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.746968:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:3.0:1788687793.746976:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687793.746999:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744494d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462cb6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.747157:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.747175:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462caf expref: 50 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.747185:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.747232:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462caf expref: 50 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.747248:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462caf expref: 50 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.747267:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839642368:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687793.747437:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687793.749821:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839642368:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687793.749862:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.750344:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.751196:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819704064 00000100:00100000:2.0:1788687793.751211:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819704064 00010000:00010000:2.0:1788687793.751275:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462caf expref: 51 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687793.751336:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:2.0:1788687793.751360:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:2349:x1875574819704064:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687793.751381:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687793.751413:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462caf expref: 51 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.751429:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462caf expref: 51 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.751457:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462caf expref: 51 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.751522:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:2.0:1788687793.751529:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.751541:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.751551:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.751587:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687793.751668:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+50:2349:x1875574819704064:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 310us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687793.751677:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00010000:00010000:3.0:1788687793.756381:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.759716:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687793.759761:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788687793.760033:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744494d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cb6 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.760063:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cb6 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.760076:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687793.760079:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788687793.760085:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad600, rc 0) 00000100:00100000:3.0:1788687793.760174:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+50:10544:x1875574819703936:12345-192.168.204.26@tcp:101:bash.0 Request processed in 13327us (13641us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788687793.760186:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 104 00000100:00100000:3.0:1788687793.771007:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.771161:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819704320 00000100:00100000:2.0:1788687793.771176:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819704320 00000100:00100000:2.0:1788687793.771324:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 105 00000100:00100000:2.0:1788687793.771338:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+50:10544:x1875574819704320:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:2.0:1788687793.771840:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.771885:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.771900:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788687793.771978:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788687793.772007:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f69f9f1c reply state 00000000319eec3a transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687793.772017:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788687793.772150:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:10544:x1875574819704320:12345-192.168.204.26@tcp:36:bash.0 Request processed in 813us (1159us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788687793.772160:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 105 00000020:00080000:2.0:1788687793.772166:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788687793.784050:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687793.786725:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819704448 00000100:00100000:1.0:1788687793.786744:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819704448 00000100:00100000:1.0:1788687793.786834:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:1.0:1788687793.786847:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:10544:x1875574819704448:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788687793.786879:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687793.786911:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744494ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462cbd expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.787048:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.787066:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cb6 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.787076:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.787084:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.787107:0:8462:0:(ldlm_request.c:384:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.787142:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cb6 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.787159:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cb6 expref: 54 pid: 5840 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687793.787204:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839642496:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687793.787342:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858eb40 going to sleep for 11 seconds 00010000:00010000:2.0:1788687793.788321:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.788336:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.788343:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.788350:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3a00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687793.788355:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.788365:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.788417:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:2.0:1788687793.788421:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687793.788425:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.788437:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.788443:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e744494e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687793.790194:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839642496:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687793.790234:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.790899:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.791013:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819704576 00000100:00100000:3.0:1788687793.791024:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819704576 00010000:00010000:3.0:1788687793.791076:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cb6 expref: 54 pid: 5840 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.791124:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:3.0:1788687793.791135:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:2349:x1875574819704576:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687793.791163:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687793.791172:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cb6 expref: 54 pid: 5840 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.791186:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cb6 expref: 54 pid: 5840 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.791214:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744494d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cb6 expref: 54 pid: 5840 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.791234:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687793.791239:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.791251:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.791260:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.791294:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687793.791379:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:2349:x1875574819704576:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 245us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.791396:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00010000:00010000:1.0:1788687793.791667:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.791677:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687793.791745:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788687793.791751:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687793.791781:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.791821:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744494ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cbd expref: 53 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.791841:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cbd expref: 52 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.791850:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:1.0:1788687793.791853:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687793.791855:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc000, rc 0) 00000100:00100000:1.0:1788687793.791892:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:10544:x1875574819704448:12345-192.168.204.26@tcp:101:bash.0 Request processed in 5048us (7859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687793.791910:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:0.0:1788687793.797123:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.797237:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819704832 00000100:00100000:2.0:1788687793.797252:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819704832 00000100:00100000:2.0:1788687793.797334:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:2.0:1788687793.797348:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:10544:x1875574819704832:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:2.0:1788687793.797747:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:10544:x1875574819704832:12345-192.168.204.26@tcp:35:bash.0 Request processed in 401us (638us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788687793.797757:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:3.0:1788687793.858054:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687793.858175:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819704960 00000100:00100000:1.0:1788687793.858190:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819704960 00000100:00100000:1.0:1788687793.858271:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:1.0:1788687793.858284:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:10550:x1875574819704960:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687793.858322:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687793.858353:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744494fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462cc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.858469:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.858530:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.858545:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687793.858592:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788687793.858596:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687793.858618:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.858649:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744494fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cc4 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.858673:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cc4 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.858707:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:1.0:1788687793.858711:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788687793.858715:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cce00, rc 0) 00000100:00100000:1.0:1788687793.858791:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:10550:x1875574819704960:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 509us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687793.858799:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:0.0:1788687793.863337:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.863455:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819705088 00000100:00100000:3.0:1788687793.863471:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819705088 00000100:00100000:3.0:1788687793.863595:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:3.0:1788687793.863608:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:10550:x1875574819705088:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687793.863661:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687793.863694:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449508 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ccb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.863787:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444950f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.863809:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444950f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.863825:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444950f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.863844:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.863851:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.863858:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.863986:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444951d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.863995:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444951d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864002:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444951d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687793.864055:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788687793.864067:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687793.864095:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444951d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864110:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444951d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864121:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444950f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864129:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444950f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864138:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444950f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864144:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687793.864150:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444950f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864158:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444950f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864173:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:3.0:1788687793.864176:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687793.864182:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444950f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864188:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444950f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864204:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864220:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449516 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864226:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864232:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aacc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687793.864235:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864242:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449516 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864250:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3ca87c400) 00010000:00010000:3.0:1788687793.864253:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687793.864256:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449516 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864262:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864303:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449508 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ccb expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864319:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444951d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ccb expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.864327:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687793.864330:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687793.864343:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad400, rc 0) 00000100:00100000:3.0:1788687793.864423:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10550:x1875574819705088:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 818us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.864432:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:0.0:1788687793.867972:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687793.868086:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.868201:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819705216 00000100:00100000:2.0:1788687793.868215:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819705216 00000100:00100000:2.0:1788687793.868309:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788687793.868323:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:2346:x1875574819705216:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687793.868342:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687793.868374:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444951d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ccb expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.868420:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:2.0:1788687793.868445:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687793.868556:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:2346:x1875574819705216:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 236us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687793.868565:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:1.0:1788687793.871584:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819705472 00000100:00100000:1.0:1788687793.871604:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819705472 00000100:00100000:1.0:1788687793.871706:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:1.0:1788687793.871719:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:10550:x1875574819705472:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687793.871747:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687793.871778:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449524 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462cd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.871923:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.871942:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cbd expref: 55 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.871962:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.872014:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cbd expref: 55 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.872031:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cbd expref: 55 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687793.872066:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839642624:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687793.872197:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788687793.875239:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839642624:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687793.875281:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687793.876581:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.876686:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819705600 00000100:00100000:3.0:1788687793.876701:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819705600 00010000:00010000:3.0:1788687793.876754:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cbd expref: 56 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687793.876808:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:3.0:1788687793.876819:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c6908050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:2349:x1875574819705600:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687793.876840:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687793.876848:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cbd expref: 56 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.876861:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cbd expref: 56 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.876890:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744494f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cbd expref: 56 pid: 8462 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.876914:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687793.876920:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.876931:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.876942:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.877049:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687793.877128:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c6908050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:2349:x1875574819705600:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 309us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.877136:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 54 00010000:00010000:1.0:1788687793.877709:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.877720:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687793.877749:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788687793.877981:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449524 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd2 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.878003:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd2 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687793.878013:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:1.0:1788687793.878016:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788687793.878019:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cde00, rc 0) 00000100:00100000:1.0:1788687793.878075:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10550:x1875574819705472:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 6359us (9989us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788687793.878084:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:0.0:1788687793.882016:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687793.882127:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819705856 00000100:00100000:2.0:1788687793.882142:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819705856 00000100:00100000:2.0:1788687793.882225:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788687793.882238:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10550:x1875574819705856:12345-192.168.204.26@tcp:103:lfs.0 00010000:00010000:2.0:1788687793.882259:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687793.882290:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444948a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ca8 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687793.882312:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:2.0:1788687793.882318:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687793.882396:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:10550:x1875574819705856:12345-192.168.204.26@tcp:103:lfs.0 Request processed in 161us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687793.882404:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788687793.885730:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.885806:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819705984 00000100:00100000:3.0:1788687793.885823:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819705984 00000100:00100000:3.0:1788687793.885914:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 110 00000100:00100000:3.0:1788687793.885927:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:10550:x1875574819705984:12345-192.168.204.26@tcp:58:lfs.0 00010000:00010000:3.0:1788687793.886109:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.886134:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.886148:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788687793.886518:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788687793.886649:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:10550:x1875574819705984:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 724us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.886659:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 110 00000100:00100000:0.0:1788687793.891023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687793.891184:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819706112 00000100:00100000:3.0:1788687793.891199:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819706112 00000100:00100000:3.0:1788687793.891281:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:3.0:1788687793.891293:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:10550:x1875574819706112:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687793.891320:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687793.891347:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462cd9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.891466:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.891516:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449540 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd9 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.891543:0:5839:0:(ldlm_request.c:384:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.891561:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449540 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd9 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.891578:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687793.891581:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788687793.891585:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449540 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd9 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687793.891594:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aacc00, rc 0) 00000100:00100000:3.0:1788687793.891671:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10550:x1875574819706112:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 380us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687793.891678:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 111 00000040:00080000:0.0:1788687794.437805:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788687794.437815:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788687794.437856:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788687794.437864:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788687794.438146:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839642752:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788687794.438370:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788687794.447921:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839642752:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788687794.448130:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687794.448274:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819706240 00000100:00100000:3.0:1788687794.448282:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819706240 00000100:00100000:3.0:1788687794.448395:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:3.0:1788687794.448406:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10551:x1875574819706240:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788687794.448437:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788687794.448594:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10551:x1875574819706240:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 191us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687794.448602:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00080000:0.0:1788687794.448788:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687794.453248:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687794.453423:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819706368 00000100:00100000:2.0:1788687794.453435:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819706368 00000100:00100000:2.0:1788687794.453719:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:2.0:1788687794.453732:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10551:x1875574819706368:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788687794.453815:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449547 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.453835:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449547 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.453868:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449547 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.453926:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444954e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.453935:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444954e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.453952:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444954e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.453976:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.453985:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.453992:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687794.454049:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788687794.454054:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687794.454067:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454078:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449547 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454085:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449547 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454101:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449547 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454107:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687794.454112:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449547 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454119:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449547 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454132:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:2.0:1788687794.454135:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687794.454139:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449547 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454155:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449547 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454171:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444954e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454177:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444954e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454184:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444954e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454189:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687794.454192:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444954e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454208:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444954e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454217:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9af3e29fef00) 00010000:00010000:2.0:1788687794.454219:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687794.454223:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444954e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454228:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444954e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454245:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454251:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454256:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454262:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687794.454265:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454271:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454278:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:2.0:1788687794.454279:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687794.454282:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.454297:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687794.454383:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10551:x1875574819706368:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 652us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687794.454391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:2.0:1788687794.461306:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687794.461802:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819706624 00000100:00100000:3.0:1788687794.461818:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819706624 00000100:00100000:3.0:1788687794.461921:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:3.0:1788687794.461934:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:10551:x1875574819706624:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687794.461975:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687794.462006:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444955c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ce0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.462158:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.462179:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.462195:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687794.462207:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788687794.463456:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.463474:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449563 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.463504:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.463538:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687794.463544:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.463563:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449563 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.463585:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687794.463588:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788687794.463604:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449563 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.463613:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.463691:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444955c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ce0 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.463702:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:3.0:1788687794.463704:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788687794.463709:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444955c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ce0 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.463720:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aade00, rc 0) 00000100:00100000:3.0:1788687794.463819:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:10551:x1875574819706624:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1886us (2528us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788687794.463830:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:0.0:1788687794.471983:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.472136:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819706752 00000100:00100000:1.0:1788687794.472151:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819706752 00000100:00100000:1.0:1788687794.472284:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:1.0:1788687794.472297:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:10551:x1875574819706752:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788687794.472364:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788687794.472605:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:10551:x1875574819706752:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 312us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687794.472614:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:0.0:1788687794.479069:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.479210:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819707008 00000100:00100000:1.0:1788687794.479225:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819707008 00000100:00100000:1.0:1788687794.479390:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:1.0:1788687794.479404:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:10551:x1875574819707008:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687794.479447:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687794.479452:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788687794.479521:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cc4 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.479546:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:1.0:1788687794.479553:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687794.479569:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449571 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ce7 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788687794.480455:0:8462:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788687794.481151:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.481172:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.481205:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.481290:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449571 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ce7 expref: 58 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.481742:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ce7 expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.481755:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3c7fb4500) 00010000:00010000:1.0:1788687794.481758:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687794.481762:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc200, rc 0) 00000100:00100000:1.0:1788687794.481858:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+57:10551:x1875574819707008:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 2457us (2805us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788687794.481869:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:0.0:1788687794.486978:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687794.487132:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819707264 00000100:00100000:2.0:1788687794.487148:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819707264 00000100:00100000:2.0:1788687794.487222:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:2.0:1788687794.487235:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+57:10551:x1875574819707264:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788687794.487323:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687794.487361:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ce7 expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.487386:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3c7fb4500) 00010000:00010000:2.0:1788687794.487399:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788687794.487438:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449586 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.487455:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.487467:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490160:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444958d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x318748f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490211:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444958d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x318748f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490225:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444958d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x318748f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490324:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490333:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449586 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490341:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490347:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687794.490353:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490361:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449586 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490376:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:2.0:1788687794.490379:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687794.490384:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449586 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490390:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449586 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490406:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444958d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x318748f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490419:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444958d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x318748f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490424:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444958d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x318748f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490428:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687794.490431:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444958d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x318748f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490438:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444958d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x318748f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490458:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x318748f0 (ffff9af3e29fef00) 00010000:00010000:2.0:1788687794.490461:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687794.490464:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444958d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x318748f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.490470:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e7444958d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x318748f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687794.490622:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:10551:x1875574819707264:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 3384us (3657us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788687794.490634:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:0.0:1788687794.496436:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687794.496525:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819707392 00000100:00100000:3.0:1788687794.496560:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819707392 00000100:00100000:3.0:1788687794.496648:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:3.0:1788687794.496661:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:10551:x1875574819707392:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687794.496688:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687794.496715:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449594 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462cee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.496763:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.496781:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.496795:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.496925:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449594 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cee expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.496956:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cee expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.496967:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:3.0:1788687794.496971:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788687794.496975:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac800, rc 0) 00000100:00100000:3.0:1788687794.497054:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+57:10551:x1875574819707392:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 397us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687794.497061:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:0.0:1788687794.502899:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.503085:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819707648 00000100:00100000:1.0:1788687794.503097:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819707648 00000100:00100000:1.0:1788687794.503164:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:1.0:1788687794.503176:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+57:10551:x1875574819707648:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788687794.503286:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.503308:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.503324:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788687794.503704:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1788687794.503716:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340194234378ns, next at 341194231431ns, rc = 0 00000004:00010000:1.0:1788687794.503974:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001a9d87e reply state 00000000329edb59 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687794.503987:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788687794.504096:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:10551:x1875574819707648:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 921us (1208us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788687794.504105:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 119 00010000:00010000:3.0:1788687794.506559:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.506618:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.506629:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.506636:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687794.506643:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.506653:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.506676:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:3.0:1788687794.506680:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788687794.506686:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.506693:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.508361:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.508980:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819707776 00000100:00100000:1.0:1788687794.508995:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819707776 00000100:00100000:1.0:1788687794.509082:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:1.0:1788687794.509095:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+58:10551:x1875574819707776:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687794.509124:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687794.509150:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744495a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462cf5 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.509222:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744495a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cf5 expref: 59 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.509239:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744495a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cf5 expref: 59 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.509262:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:1.0:1788687794.509266:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687794.509270:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cce00, rc 0) 00000100:00100000:1.0:1788687794.509374:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:10551:x1875574819707776:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 282us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687794.509381:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:0.0:1788687794.515678:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687794.515874:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819707904 00000100:00100000:2.0:1788687794.515886:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819707904 00000100:00100000:2.0:1788687794.515991:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:2.0:1788687794.516003:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819707904:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788687794.516336:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2349:x1875574819707904:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 335us (670us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788687794.516358:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:1.0:1788687794.519865:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687794.519981:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819708160 00000100:00100000:2.0:1788687794.519994:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819708160 00000100:00100000:2.0:1788687794.520091:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:2.0:1788687794.520102:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:10551:x1875574819708160:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788687794.520390:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:10551:x1875574819708160:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 289us (538us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788687794.520397:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:3.0:1788687794.525353:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687794.525800:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819708416 00000100:00100000:2.0:1788687794.525816:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819708416 00000100:00100000:2.0:1788687794.526075:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:2.0:1788687794.526089:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:10551:x1875574819708416:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788687794.526272:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:10551:x1875574819708416:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 185us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687794.526282:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:0.0:1788687794.529698:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.529817:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819708544 00000100:00100000:1.0:1788687794.529832:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819708544 00000100:00100000:1.0:1788687794.529916:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:1.0:1788687794.529929:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:10551:x1875574819708544:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687794.529970:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687794.530002:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462cfc expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.530102:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.530121:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.530136:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687794.530188:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687794.530213:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.530252:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744495b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cfc expref: 62 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.530279:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cfc expref: 61 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.530314:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:1.0:1788687794.530318:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788687794.530322:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc200, rc 0) 00000100:00100000:1.0:1788687794.530420:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:10551:x1875574819708544:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 493us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687794.530428:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:3.0:1788687794.534331:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687794.534473:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819708672 00000100:00100000:0.0:1788687794.534525:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819708672 00000100:00100000:0.0:1788687794.534612:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:0.0:1788687794.534628:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2349:x1875574819708672:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788687794.534661:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687794.534718:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc0542d2/0xc2ddd83e744495be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d03 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788687794.534766:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d35b2, blocks: 0x1 00010000:00010000:0.0:1788687794.534797:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1788687794.534803:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687794.534820:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc0542d2/0xc2ddd83e744495be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d03 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.534850:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc0542d2/0xc2ddd83e744495be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d03 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.534868:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ede00, rc 0) 00000100:00100000:0.0:1788687794.535164:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:2349:x1875574819708672:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 538us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687794.535172:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:0.0:1788687794.538193:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.538324:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819708928 00000100:00100000:1.0:1788687794.538337:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819708928 00000100:00100000:1.0:1788687794.538421:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:1.0:1788687794.538435:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:10551:x1875574819708928:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788687794.538832:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:10551:x1875574819708928:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 399us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687794.538841:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:2.0:1788687794.552719:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687794.552821:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819709056 00000100:00100000:0.0:1788687794.552838:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819709056 00000100:00100000:0.0:1788687794.552926:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:0.0:1788687794.553060:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:10551:x1875574819709056:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788687794.553087:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687794.553115:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d0a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.553256:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc0542d2/0xc2ddd83e744495be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d03 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.553292:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687794.553297:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687794.553304:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.553420:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc0542d2/0xc2ddd83e744495be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d03 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.553439:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc0542d2/0xc2ddd83e744495be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d03 expref: 11 pid: 6687 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.553459:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875574839642880:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687794.553741:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6900 going to sleep for 11 seconds 00000100:00100000:0.0:1788687794.558971:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875574839642880:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687794.559030:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.559060:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec200, rc 0) 00000100:00100000:0.0:1788687794.559154:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:10551:x1875574819709056:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 6099us (6454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687794.559167:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:3.0:1788687794.559777:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687794.560117:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819709184 00000100:00100000:0.0:1788687794.560127:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819709184 00010000:00010000:0.0:1788687794.560178:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc0542d2/0xc2ddd83e744495be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d03 expref: 11 pid: 6687 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.560237:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:0.0:1788687794.560248:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:2349:x1875574819709184:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687794.560268:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687794.560300:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc0542d2/0xc2ddd83e744495be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d03 expref: 11 pid: 6687 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.560315:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc0542d2/0xc2ddd83e744495be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d03 expref: 11 pid: 6687 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.560348:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc0542d2/0xc2ddd83e744495be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d03 expref: 11 pid: 6687 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.560370:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687794.560375:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687794.560386:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.560399:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.561563:0:7632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.561588:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7632:1875574839643008:192.168.204.26@tcp:105: 00000100:00100000:0.0:1788687794.561898:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d04d6900 going to sleep for 11 seconds 00000100:00100000:0.0:1788687794.566752:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7632:1875574839643008:192.168.204.26@tcp:105: 00010000:00010000:0.0:1788687794.566795:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687794.567009:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:2349:x1875574819709184:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 6761us (7233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687794.567022:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:3.0:1788687794.571293:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687794.571780:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819709312 00000100:00100000:0.0:1788687794.571862:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819709312 00002000:00100000:1.0:1788687794.572109:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9af3fba98a80 x1875574819709312/t0(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:695/0 lens 504/0 e 0 to 0 dl 1788687805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788687794.572125:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3fba98a80 with x1875574819709312 ext(0->12) 00002000:00010000:1.0:1788687794.572133:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3fba98a80 00000100:00100000:1.0:1788687794.572225:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:1.0:1788687794.572237:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:2346:x1875574819709312:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788687794.573112:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:2346:x1875574819709312:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 Request processed in 871us (1832us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788687794.573123:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00002000:00100000:1.0:1788687794.573133:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9af3fba98a80 x1875574819709312/t4294967309(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:695/0 lens 504/448 e 0 to 0 dl 1788687805 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788687794.573151:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3fba98a80 with x1875574819709312 ext(0->12) 00002000:00010000:1.0:1788687794.573156:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3fba98a80 00000100:00100000:2.0:1788687794.575321:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687794.575559:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819709440 00000100:00100000:3.0:1788687794.575572:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819709440 00000100:00100000:3.0:1788687794.575645:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:3.0:1788687794.575658:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:10551:x1875574819709440:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788687794.658220:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:10551:x1875574819709440:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 82552us (82901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687794.658235:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 124 00000001:00080000:0.0:1788687794.658571:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967388 is committed 00000004:00080000:0.0:1788687794.658579:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788687794.658832:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687794.658849:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839643136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788687794.658907:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687794.659031:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839643136 00000100:00100000:3.0:1788687794.659040:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839643136 00000100:00100000:3.0:1788687794.659103:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788687794.659113:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839643136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788687794.659141:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788687794.659179:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9d35b0, atime: 0x6a9d35b1, ctime: 0x6a9d35b0, blocks: 0x1 00010000:00010000:3.0:1788687794.659187:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c296292c/0xc2ddd83e744495cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.659205:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1788687794.659209:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687794.659216:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c296292c/0xc2ddd83e744495cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.659233:0:6686:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c296292c/0xc2ddd83e744495cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.659244:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c296292c/0xc2ddd83e744495cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.659252:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c296292c/0xc2ddd83e744495cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.659271:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788687794.659879:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839643136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 767us (971us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788687794.659898:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1788687794.659925:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687794.659932:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c296292c/0xc2ddd83e744495cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.659954:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687794.659959:0:5827:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c296292c/0xc2ddd83e744495cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.659969:0:5827:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c296292c/0xc2ddd83e744495cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.659987:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c296292c/0xc2ddd83e744495cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.659994:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c296292c/0xc2ddd83e744495cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.660015:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687794.660018:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687794.660019:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788687794.660121:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3fba9b800/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788687794.660128:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839643136:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1788687794.660703:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9af3d04d6180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788687794.660711:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3f1515e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9af3d04d6780 00000020:00080000:0.0:1788687794.660714:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3f1515000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9af3c1219800 00000020:00080000:0.0:1788687794.660740:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9af3d01713c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788687794.660744:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3c8bac400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9af3d0171cc0 00000020:00080000:0.0:1788687794.660748:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3c8bacb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9af3f799d800 00000001:00080000:0.0:1788687794.660772:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1788687794.660777:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:0.0:1788687794.660818:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788687794.660833:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788687794.661124:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788687794.661289:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788687794.661359:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839643264:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788687794.661416:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687794.661513:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788687794.661521:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839643392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788687794.661544:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687794.661764:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839643264 00000100:00100000:1.0:1788687794.661772:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839643264 00000100:00100000:1.0:1788687794.661821:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839643392 00000100:00100000:1.0:1788687794.661824:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839643392 00000100:00100000:1.0:1788687794.661844:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788687794.661853:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839643264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788687794.661882:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1788687794.661909:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.661932:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444938e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c69 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.661953:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788687794.661957:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788687794.661962:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.661996:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444938e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c69 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.662025:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444938e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c69 expref: 11 pid: 6686 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687794.662038:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875574839643520:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687794.662102:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788687794.662258:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788687794.662267:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839643392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788687794.662398:0:8309:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788687794.662402:0:8309:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788687794 00002000:00010000:2.0:1788687794.662405:0:8309:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788687794.662407:0:8309:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788687794 -> 1788687794 00002000:00010000:2.0:1788687794.662410:0:8309:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788687794.662464:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839643392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (918us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788687794.662471:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:1.0:1788687794.662621:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3c315c000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788687794.662628:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839643392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788687794.662966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687794.663172:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819709568 00000100:00100000:0.0:1788687794.663179:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819709568 00000100:00100000:0.0:1788687794.663257:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:0.0:1788687794.663266:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:2348:x1875574819709568:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788687794.667287:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875574839643520:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687794.667320:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687794.667379:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687794.667596:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819709696 00000100:00100000:0.0:1788687794.667604:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819709696 00010000:00010000:0.0:1788687794.667641:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444938e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c69 expref: 13 pid: 6686 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.667680:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:0.0:1788687794.667689:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:2348:x1875574819709696:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687794.667705:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687794.667710:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444938e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c69 expref: 13 pid: 6686 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.667723:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444938e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c69 expref: 13 pid: 6686 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.667748:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444938e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c69 expref: 13 pid: 6686 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.667765:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788687794.667769:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788687794.667775:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.667802:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.667834:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687794.667885:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:2348:x1875574819709696:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 196us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687794.667893:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00010000:00010000:1.0:1788687794.667911:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.667921:0:6689:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.667931:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.667950:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.667980:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788687794.669797:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687794.669809:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.669821:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687794.669825:0:5828:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.669834:0:5828:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.669852:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.669858:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e65aab9/0xc2ddd83e744495d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.669880:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687794.669893:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687794.669894:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687794.670024:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839643264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8166us (8602us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788687794.670038:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1788687794.670102:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3c315fb80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788687794.670109:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839643264:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788687794.689179:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1788687794.689203:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788687794.689212:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:0.0:1788687794.689453:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819709568:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 26180us (26480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687794.689465:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00010000:00010000:3.0:1788687794.693689:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687794.695868:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.695990:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819709952 00000100:00100000:1.0:1788687794.696002:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819709952 00000100:00100000:1.0:1788687794.696113:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:1.0:1788687794.696124:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:10551:x1875574819709952:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788687794.696186:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687794.696216:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cfc expref: 15 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.696240:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:1.0:1788687794.696246:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687794.696280:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.696294:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.696302:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788687794.696638:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b083dd6c reply state 00000000baeeda41 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687794.696671:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788687794.696798:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:10551:x1875574819709952:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 676us (940us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788687794.696807:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 125 00010000:00010000:2.0:1788687794.699882:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.699901:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.699909:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.699916:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687794.699921:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.699930:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.699961:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:2.0:1788687794.699980:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687794.699986:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.699993:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744495da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687794.701006:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687794.702325:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819710080 00000100:00100000:0.0:1788687794.702340:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819710080 00000100:00100000:1.0:1788687794.702737:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:1.0:1788687794.702761:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819710080:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788687794.702997:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788687794.703001:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788687794 -> 1788687793 00002000:00010000:1.0:1788687794.703004:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788687793 00002000:00010000:1.0:1788687794.703006:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788687794 -> 1788687793 00002000:00010000:1.0:1788687794.703008:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788687794.703077:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2347:x1875574819710080:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 329us (2078us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788687794.703086:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:3.0:1788687794.705707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687794.705950:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819710336 00000100:00100000:2.0:1788687794.705965:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819710336 00000100:00100000:2.0:1788687794.706041:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:2.0:1788687794.706054:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:10551:x1875574819710336:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788687794.706267:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.706290:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cee expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.706302:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.706347:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cee expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.706427:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cee expref: 15 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687794.706539:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c3118700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839643648:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687794.706701:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4020e69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687794.709258:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c3118700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839643648:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687794.709296:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687794.711272:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687794.711528:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819710464 00000100:00100000:0.0:1788687794.711541:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819710464 00010000:00010000:0.0:1788687794.711755:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cee expref: 16 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.711810:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:0.0:1788687794.711825:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:2348:x1875574819710464:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687794.712249:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687794.712274:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cee expref: 16 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.712293:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cee expref: 16 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.712323:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444959b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cee expref: 16 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.713526:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:1.0:1788687794.713561:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.713575:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.713584:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.713632:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687794.713720:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:2348:x1875574819710464:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 1895us (2458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687794.713733:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00010000:00010000:0.0:1788687794.713765:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.713781:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.713825:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.713834:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.713842:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.713849:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687794.713854:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.713881:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.713910:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:0.0:1788687794.713914:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788687794.713920:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.713931:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744495e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.714270:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:10551:x1875574819710336:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 Request processed in 8215us (8576us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788687794.714281:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:3.0:1788687794.717653:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.717932:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819710592 00000100:00100000:1.0:1788687794.717960:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819710592 00000100:00100000:1.0:1788687794.718043:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:1.0:1788687794.718060:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819710592:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788687794.718126:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.718151:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.718161:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687794.718166:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788687794.718171:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.718210:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.718241:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 7 pid: 6689 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687794.718257:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875574839643776:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687794.718352:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687794.725713:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875574839643776:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687794.725725:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:1.0:1788687794.725834:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.725927:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819710720 00000100:00100000:0.0:1788687794.725951:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819710720 00010000:00010000:0.0:1788687794.726015:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 8 pid: 6689 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.726071:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:0.0:1788687794.726083:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3118700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819710720:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687794.726104:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687794.726141:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 8 pid: 6689 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.726158:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 8 pid: 6689 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.726223:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe0a22c0/0xc2ddd83e744495c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d0a expref: 8 pid: 6689 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.726247:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788687794.726253:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788687794.726263:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.726275:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.726312:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687794.726390:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3118700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819710720:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 308us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687794.726399:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00010000:00010000:1.0:1788687794.726552:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.726567:0:6689:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.726613:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.726623:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.726632:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.727050:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687794.727054:0:6689:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.727063:0:6689:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.727083:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.727091:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002586d73e/0xc2ddd83e744495e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687794.727286:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819710592:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 9228us (9656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687794.727297:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:2.0:1788687794.742584:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.742679:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819710976 00000100:00100000:1.0:1788687794.742691:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819710976 00000100:00100000:1.0:1788687794.742763:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:1.0:1788687794.742778:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:10551:x1875574819710976:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788687794.742857:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.742875:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.742905:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.743125:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.743137:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744495a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cf5 expref: 15 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.743146:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.743181:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744495a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cf5 expref: 15 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.743196:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744495a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cf5 expref: 15 pid: 8462 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687794.743210:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839643904:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687794.743299:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687794.746419:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.748467:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839643904:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687794.748527:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687794.748926:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819711104 00000100:00100000:3.0:1788687794.748946:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819711104 00010000:00010000:0.0:1788687794.751887:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744495a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cf5 expref: 16 pid: 8462 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.752023:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:0.0:1788687794.752038:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:2349:x1875574819711104:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687794.752061:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687794.752069:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744495a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cf5 expref: 16 pid: 8462 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.752084:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744495a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cf5 expref: 16 pid: 8462 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.752143:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744495a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cf5 expref: 16 pid: 8462 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.752170:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:0.0:1788687794.752178:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.752189:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.752198:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.752652:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687794.752740:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:2349:x1875574819711104:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 705us (6392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687794.752750:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00010000:00010000:2.0:1788687794.753379:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687794.753391:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788687794.753684:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788687794.753870:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788687794.753922:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788687794.754052:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b15880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875574839644032:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788687794.754155:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687794.755878:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788687794.756392:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839644032 00000100:00100000:1.0:1788687794.756405:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839644032 00000100:00100000:1.0:1788687794.756522:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788687794.756535:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875574839644032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788687794.756720:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875574839644032:12345-0@lo:1000:mdt00_002.0 Request processed in 187us (2564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687794.756730:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788687794.757080:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788687794.757088:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3c315c000, transno 4294967310 00000100:00100000:2.0:1788687794.757113:0:5841:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9af3c315fb80 x1875574839643264/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788687810 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687794.757128:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b15880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875574839644032:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788687794.759184:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788687794.759584:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b15880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875574839644160:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788687794.759677:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687794.759717:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4020e69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687794.760380:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839644160 00000100:00100000:1.0:1788687794.760391:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839644160 00000100:00100000:1.0:1788687794.760909:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788687794.760925:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875574839644160:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788687794.761555:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1875574839644160:12345-0@lo:1000:mdt00_002.0 Request processed in 631us (1875us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788687794.761567:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788687794.761754:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b15880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875574839644160:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788687794.761810:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.761821:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.761830:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.761837:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687794.761843:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.761853:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.761872:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:3.0:1788687794.761876:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788687794.761881:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.761902:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e744495f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.761956:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.761963:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.761988:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.761993:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687794.761997:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.762003:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.762013:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687794.762015:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788687794.762025:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.762037:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449540 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.762049:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.762107:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687794.762125:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839644288:192.168.204.26@tcp:105: 00000100:00100000:3.0:1788687794.762230:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687794.767032:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687794.767150:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839644288:192.168.204.26@tcp:105: 00010000:00010000:3.0:1788687794.767225:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767239:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449539 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767281:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744495fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767298:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744495fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767312:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744495fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767325:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744495fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767332:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744495fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767339:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744495fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767345:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687794.767349:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744495fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767358:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744495fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767374:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687794.767377:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687794.767390:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744495fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767396:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744495fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767407:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767413:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767419:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767425:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687794.767428:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767435:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767443:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687794.767445:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788687794.767448:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.767454:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744495ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788687794.768020:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788687794.768028:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788687794.768552:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788687794.768564:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788687794.768713:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:10551:x1875574819710976:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 25932us (26134us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788687794.768729:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 127 00000020:00080000:3.0:1788687794.768756:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788687794.768951:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819711232 00000100:00100000:1.0:1788687794.768963:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819711232 00000100:00100000:1.0:1788687794.769026:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:1.0:1788687794.769037:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:10550:x1875574819711232:12345-192.168.204.26@tcp:49:lfs.0 00000100:00100000:1.0:1788687794.769183:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:10550:x1875574819711232:12345-192.168.204.26@tcp:49:lfs.0 Request processed in 148us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687794.769191:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:2.0:1788687794.774114:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687794.778407:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819711488 00000100:00100000:3.0:1788687794.778431:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819711488 00000100:00100000:3.0:1788687794.778650:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:3.0:1788687794.778664:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b94050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:10551:x1875574819711488:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788687794.780604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000004:00080000:3.0:1788687794.781371:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788687794.781551:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788687794.781644:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.781666:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.781681:0:5843:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.781693:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.781700:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.781707:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.781737:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788687794.781891:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b94050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:10551:x1875574819711488:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 3228us (7789us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788687794.781903:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000020:00080000:3.0:1788687794.781910:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788687794.782036:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687794.782047:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.782057:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687794.782062:0:5828:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.782087:0:5828:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.782103:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:0.0:1788687794.782106:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788687794.782111:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.782117:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449604 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.782138:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687794.782141:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687794.782142:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687794.783207:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819711744 00000100:00100000:1.0:1788687794.783225:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819711744 00000100:00100000:0.0:1788687794.783633:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:0.0:1788687794.783647:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:10550:x1875574819711744:12345-192.168.204.26@tcp:58:lfs.0 00000040:00080000:0.0:1788687794.783983:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788687794.784098:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:10550:x1875574819711744:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 453us (3506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687794.784108:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:2.0:1788687794.812849:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.813017:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819711872 00000100:00100000:1.0:1788687794.813031:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819711872 00000100:00100000:1.0:1788687794.813111:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:1.0:1788687794.813123:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:10553:x1875574819711872:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687794.813168:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687794.813198:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444960b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d11 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813311:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449612 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813331:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813345:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813375:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813383:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813390:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813771:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813785:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd2 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813795:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813838:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd2 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687794.813867:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd2 expref: 21 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687794.813886:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839644416:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687794.814024:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687794.817327:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687794.817582:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839644416:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687794.817619:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687794.817965:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819712128 00000100:00100000:2.0:1788687794.817975:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819712128 00000100:00100000:2.0:1788687794.818084:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:2.0:1788687794.818095:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:9241:x1875574819712128:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788687794.818454:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:9241:x1875574819712128:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 359us (1142us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788687794.818462:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:2.0:1788687794.821382:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687794.821612:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819712256 00000100:00100000:3.0:1788687794.821625:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819712256 00010000:00010000:0.0:1788687794.821775:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd2 expref: 23 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687794.821880:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:0.0:1788687794.821892:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c690b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:2349:x1875574819712256:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687794.821911:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687794.821920:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd2 expref: 23 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.821965:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd2 expref: 23 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.821993:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e7444952b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd2 expref: 23 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.822014:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:0.0:1788687794.822020:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.822030:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.822038:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687794.822121:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687794.822192:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c690b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:2349:x1875574819712256:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 302us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687794.822200:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00010000:00010000:3.0:1788687794.822383:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822393:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687794.822461:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788687794.822467:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687794.822667:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822684:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822696:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822703:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449612 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822710:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822717:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687794.822722:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822732:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449612 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822743:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:3.0:1788687794.822755:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687794.822761:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822767:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822781:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822787:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449619 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822792:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822798:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cda00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687794.822800:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822806:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822813:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9af3c7fb4f00) 00010000:00010000:3.0:1788687794.822816:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687794.822819:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449619 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822823:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822866:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444960b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d11 expref: 22 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822899:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d11 expref: 21 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687794.822908:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687794.822910:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687794.822913:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd600, rc 0) 00000100:00100000:3.0:1788687794.823026:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:10553:x1875574819711872:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 9905us (10193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687794.823035:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:3.0:1788687795.180054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687795.180134:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687795.180251:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687795.180329:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819712512 00000100:00100000:0.0:1788687795.180342:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819712512 00000100:00100000:0.0:1788687795.180430:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:0.0:1788687795.180454:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819712512:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687795.180584:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819712512:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 134us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687795.180593:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:1.0:1788687795.180983:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819712640 00000100:00100000:1.0:1788687795.180989:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819712640 00000100:00100000:1.0:1788687795.181040:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 136 00000100:00100000:1.0:1788687795.181048:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+5:2348:x1875574819712640:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687795.181092:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+5:2348:x1875574819712640:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 46us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687795.181099:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 136 00000100:00080000:3.0:1788687795.181246:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788687795.181252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687795.181843:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819712384 00000100:00100000:2.0:1788687795.181850:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819712384 00000100:00100000:3.0:1788687795.182062:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 288 00000100:00100000:3.0:1788687795.182072:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2348:x1875574819712384:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687795.182132:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2348:x1875574819712384:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 61us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687795.182139:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 288 00000040:00080000:2.0:1788687795.498642:0:12108:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788687795.498652:0:12108:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788687795.498705:0:12108:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788687795.498712:0:12108:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788687795.717657:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788687795.781784:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788687795.781794:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788687795.781835:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788687795.781843:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788687795.782137:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839644544:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788687795.782326:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f159e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788687795.785810:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687795.786047:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819712768 00000100:00100000:3.0:1788687795.786058:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819712768 00000100:00100000:3.0:1788687795.786123:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:3.0:1788687795.786133:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:10565:x1875574819712768:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788687795.786172:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788687795.786298:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:10565:x1875574819712768:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 166us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687795.786316:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:0.0:1788687795.789814:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839644544:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788687795.797668:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687795.797781:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819713024 00000100:00100000:1.0:1788687795.797797:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819713024 00000100:00100000:1.0:1788687795.797876:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 131 00000100:00100000:1.0:1788687795.797887:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:10565:x1875574819713024:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687795.797908:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687795.797942:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449627 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687795.798069:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444962e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687795.798101:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444962e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687795.798114:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444962e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687795.798134:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788687795.798648:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449627 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d18 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687795.798672:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444962e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d18 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687795.798680:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:1.0:1788687795.798683:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687795.798687:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc200, rc 0) 00000100:00100000:1.0:1788687795.798812:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:10565:x1875574819713024:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 926us (1411us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788687795.798820:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 131 00000100:00100000:2.0:1788687795.804092:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687795.804434:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819713280 00000100:00100000:2.0:1788687795.805831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687795.805910:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819713408 00000100:00100000:1.0:1788687795.805934:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819713408 00000100:00100000:1.0:1788687795.806010:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:1.0:1788687795.806022:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:2347:x1875574819713408:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687795.806052:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687795.806080:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e7444962e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d18 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687795.806119:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:1.0:1788687795.806124:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687795.806233:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:2347:x1875574819713408:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 213us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687795.806240:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:3.0:1788687795.809588:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819713280 00000100:00100000:3.0:1788687795.809868:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 132 00000100:00100000:3.0:1788687795.809885:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:10565:x1875574819713280:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788687795.810008:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444963c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687795.810033:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444963c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687795.810050:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444963c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687795.810320:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444963c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687795.810330:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444963c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687795.810337:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444963c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687795.810344:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687795.810349:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444963c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687795.810360:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444963c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687795.810394:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:3.0:1788687795.810397:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788687795.810404:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444963c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687795.810417:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444963c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687795.810662:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:10565:x1875574819713280:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 781us (6584us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788687795.810673:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 132 00000040:00080000:1.0:1788687795.810864:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687795.810873:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687795.814934:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788687795.814962:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788687795.821084:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687795.821161:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819713664 00000100:00100000:3.0:1788687795.821176:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819713664 00000100:00100000:3.0:1788687795.821320:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:3.0:1788687795.821336:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:10565:x1875574819713664:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788687795.822016:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:10565:x1875574819713664:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 682us (945us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788687795.822026:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00010000:00010000:1.0:1788687796.742934:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788687797.348258:0:12159:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687797.348272:0:12159:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687797.348322:0:12159:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788687797.348328:0:12159:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788687797.522909:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687797.523026:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819713920 00000100:00100000:0.0:1788687797.523042:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819713920 00000100:00080000:3.0:1788687797.523139:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687797.523162:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 133 00000100:00100000:0.0:1788687797.523188:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:10586:x1875574819713920:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687797.523217:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687797.523238:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e74449643 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d1f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.523339:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444964a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.523354:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444964a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.523368:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444964a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687797.523380:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788687797.523539:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e74449643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d1f expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.523559:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444964a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d1f expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.523583:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:0.0:1788687797.523586:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788687797.523590:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ece00, rc 0) 00000100:00100000:0.0:1788687797.523653:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:10586:x1875574819713920:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 468us (752us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788687797.523660:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 133 00000100:00100000:1.0:1788687797.528762:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687797.528924:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819714048 00000100:00100000:0.0:1788687797.528934:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819714048 00000100:00100000:0.0:1788687797.529043:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 134 00000100:00100000:0.0:1788687797.529054:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:10586:x1875574819714048:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:0.0:1788687797.529123:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.529140:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.529152:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.529179:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.529185:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449658 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.529192:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.529196:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79edc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687797.529214:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.529222:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.529234:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:0.0:1788687797.529237:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788687797.529241:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449658 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.529247:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e74449658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687797.529327:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:10586:x1875574819714048:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 275us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687797.529335:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 134 00000100:00100000:2.0:1788687797.627921:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687797.630622:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819714176 00000100:00100000:0.0:1788687797.630641:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819714176 00000100:00100000:0.0:1788687797.630746:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:0.0:1788687797.630761:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819714176:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:0.0:1788687797.630784:0:8309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687797.630810:0:8309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444965f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d26 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788687797.630841:0:8309:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9d35b1, atime: 0x6a9d35b1, ctime: 0x6a9d35b1, blocks: 0xb 00010000:00010000:0.0:1788687797.630862:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1788687797.630867:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687797.630877:0:8309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444965f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d26 expref: 7 pid: 8309 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.630928:0:8309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444965f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d26 expref: 7 pid: 8309 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687797.630944:0:8309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79edc00, rc 0) 00000100:00080000:3.0:1788687797.631131:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788687797.631257:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819714176:12345-192.168.204.26@tcp:101:cat.0 Request processed in 501us (3346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687797.631264:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:2.0:1788687797.641009:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687797.641856:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819714304 00000100:00100000:0.0:1788687797.641869:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819714304 00002000:00100000:0.0:1788687797.641938:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9af3fb82c700 x1875574819714304/t0(0) o3->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:698/0 lens 488/0 e 0 to 0 dl 1788687808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788687797.641949:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3fb82c700 with x1875574819714304 ext(0->4095) 00002000:00010000:0.0:1788687797.641954:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3fb82c700 00000100:00100000:0.0:1788687797.642054:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:0.0:1788687797.642064:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819714304:12345-192.168.204.26@tcp:3:cat.0 00000100:00100000:0.0:1788687797.642432:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819714304:12345-192.168.204.26@tcp:3:cat.0 Request processed in 367us (1432us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788687797.642441:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00002000:00100000:0.0:1788687797.642448:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9af3fb82c700 x1875574819714304/t0(0) o3->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:698/0 lens 488/4536 e 0 to 0 dl 1788687808 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788687797.642456:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3fb82c700 with x1875574819714304 ext(0->4095) 00002000:00010000:0.0:1788687797.642460:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3fb82c700 00010000:00010000:3.0:1788687797.765651:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687798.346566:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839644672:0@lo:400:kworker.0 00000100:00100000:0.0:1788687798.346653:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687798.346703:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c3118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839645184:0@lo:400:kworker.0 00000100:00100000:0.0:1788687798.346730:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687798.346757:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788687798.346762:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839644800:0@lo:400:kworker.0 00000100:00100000:0.0:1788687798.346782:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687798.346798:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839645312:0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.349324:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839644672 00000100:00100000:1.0:1788687798.349339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839644672 00000100:00100000:0.0:1788687798.349644:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687798.349684:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788687798.349694:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839645184 00000100:00100000:1.0:1788687798.349700:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839644672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687798.349701:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839645184 00000100:00100000:0.0:1788687798.349751:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839644800 00000100:00100000:0.0:1788687798.349755:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839644800 00000100:00100000:0.0:1788687798.349783:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788687798.349786:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839644672:12345-0@lo:400:kworker.0 Request processed in 91us (3132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687798.349795:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839645184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.349799:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788687798.349836:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839645184:12345-0@lo:400:kworker.0 Request processed in 45us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687798.349843:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788687798.349856:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788687798.349862:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839644800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687798.349903:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839644800:12345-0@lo:400:kworker.0 Request processed in 40us (3119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687798.349909:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788687798.349961:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839645312 00000100:00100000:0.0:1788687798.349965:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839645312 00000100:00100000:0.0:1788687798.349994:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788687798.350000:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839645312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.350039:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c311b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839645056:0@lo:400:kworker.0 00000100:00100000:0.0:1788687798.350064:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839645312:12345-0@lo:400:kworker.0 Request processed in 64us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687798.350071:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788687798.350088:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788687798.350093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788687798.350410:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687798.350438:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788687798.350445:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839644928:0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.350507:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687798.350579:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839644800:0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.350593:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839645312:0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.350603:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839644672:0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.350614:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c3118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839645184:0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.350651:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839645056 00000100:00100000:1.0:1788687798.350655:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839645056 00000100:00100000:1.0:1788687798.350687:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788687798.350695:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875574839645056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.350732:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875574839645056:12345-0@lo:400:kworker.0 Request processed in 38us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687798.350738:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788687798.350923:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c311b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839645056:0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.350949:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839644928 00000100:00100000:1.0:1788687798.350952:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839644928 00000100:00100000:1.0:1788687798.351055:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788687798.351130:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839644928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687798.351170:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839644928:12345-0@lo:400:kworker.0 Request processed in 109us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687798.351176:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788687798.351203:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839644928:0@lo:400:kworker.0 00000100:00080000:1.0:1788687798.351225:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788687798.351230:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687798.352633:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839645440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788687798.352683:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687798.353132:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839645440 00000100:00100000:1.0:1788687798.353148:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839645440 00000100:00100000:1.0:1788687798.353287:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788687798.353297:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839645440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788687798.353332:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687798.353387:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839645440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687798.353395:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788687798.354056:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839645440:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788687798.418177:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1788687798.418205:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1788687798.418211:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:1.0:1788687798.790385:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687798.854519:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788687798.854544:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839645568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687798.854618:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687798.854665:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839645568 00000100:00100000:3.0:1788687798.854675:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839645568 00000100:00100000:3.0:1788687798.854730:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788687798.854741:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839645568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788687798.854784:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687798.854838:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839645568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687798.854845:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788687798.854909:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839645568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788687799.815984:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788687799.926136:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788687799.926181:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9af3c5b2fb40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788687799.926188:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3eea7a600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9af3d2925240 00000020:00080000:0.0:1788687799.926193:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3eea7a400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9af3fc1a6c00 00000020:00080000:0.0:1788687799.926218:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788687799.926288:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788687799.926639:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1788687799.936749:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1788687799.936770:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:3.0:1788687800.304416:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687800.304534:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687800.304568:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687800.304594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687800.304627:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687800.304660:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819714944 00000100:00100000:3.0:1788687800.304673:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819714944 00000100:00100000:3.0:1788687800.304750:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819714560 00000100:00100000:3.0:1788687800.304754:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819714560 00000100:00100000:3.0:1788687800.304804:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 140 00000100:00100000:3.0:1788687800.304816:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e3c77f5-0083-4021-afe4-5890473fab59+5:2349:x1875574819714944:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687800.304936:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e3c77f5-0083-4021-afe4-5890473fab59+5:2349:x1875574819714944:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 120us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687800.304945:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 140 00000100:00100000:3.0:1788687800.304966:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 141 00000100:00100000:3.0:1788687800.304973:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:2349:x1875574819714560:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687800.305000:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:2349:x1875574819714560:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687800.305006:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 141 00000100:00100000:3.0:1788687800.305029:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819714688 00000100:00100000:3.0:1788687800.305044:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819714688 00000100:00100000:3.0:1788687800.305073:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819714816 00000100:00100000:3.0:1788687800.305076:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819714816 00000100:00100000:3.0:1788687800.305094:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:3.0:1788687800.305100:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819714688:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687800.305508:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:1.0:1788687800.305520:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819714816:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687800.307307:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819714432 00000100:00100000:2.0:1788687800.307323:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819714432 00000100:00100000:2.0:1788687800.307403:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 290 00000100:00100000:2.0:1788687800.307414:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2349:x1875574819714432:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687800.309335:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819714816:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 3793us (4682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687800.309352:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00080000:1.0:1788687800.309917:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788687800.309924:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788687800.309928:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687800.310393:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2349:x1875574819714688:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 5285us (5853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687800.310406:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:3.0:1788687800.317944:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2349:x1875574819714432:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 10508us (13525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687800.317963:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 290 00010000:00010000:1.0:1788687800.846972:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687801.861125:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687801.861239:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819715072 00000100:00100000:3.0:1788687801.861253:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819715072 00000100:00100000:3.0:1788687801.861332:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 135 00000100:00100000:3.0:1788687801.861345:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10231:x1875574819715072:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788687801.861581:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10231:x1875574819715072:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 Request processed in 237us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687801.861591:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 135 00010000:00010000:0.0:1788687801.862915:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687801.870298:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687801.870549:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819715328 00000100:00100000:2.0:1788687801.870564:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819715328 00000100:00100000:2.0:1788687801.870655:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:2.0:1788687801.870669:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:10231:x1875574819715328:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788687801.871153:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:10231:x1875574819715328:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 486us (870us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788687801.871162:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:1.0:1788687802.330513:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687802.330617:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819715456 00000100:00100000:2.0:1788687802.330632:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819715456 00000100:00100000:2.0:1788687802.330756:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 136 00000100:00100000:2.0:1788687802.330769:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:11039:x1875574819715456:12345-192.168.204.26@tcp:101:lsof.0 00010000:00010000:2.0:1788687802.330804:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687802.330831:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d2d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687802.330911:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687802.330927:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687802.330962:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687802.331006:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788687802.331010:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687802.331055:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687802.331082:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e74449666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d2d expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687802.331104:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d2d expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687802.331114:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:2.0:1788687802.331117:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687802.331121:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2e00, rc 0) 00000100:00100000:2.0:1788687802.331203:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+6:11039:x1875574819715456:12345-192.168.204.26@tcp:101:lsof.0 Request processed in 437us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687802.331209:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 136 00000100:00080000:1.0:1788687802.333145:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788687802.885851:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788687803.014741:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687803.014772:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687803.015184:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788687803.015194:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788687803.462025:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839645952:0@lo:400:kworker.0 00000100:00100000:2.0:1788687803.462123:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687803.462203:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788687803.462210:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839646080:0@lo:400:kworker.0 00000100:00100000:2.0:1788687803.462239:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687803.462274:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839646080 00000100:00100000:2.0:1788687803.462284:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839646080 00000100:00100000:3.0:1788687803.462293:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839645952 00000100:00100000:3.0:1788687803.462297:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839645952 00000100:00100000:3.0:1788687803.462380:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788687803.462393:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839645952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687803.462401:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839645696:0@lo:400:kworker.0 00000100:00100000:1.0:1788687803.462438:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687803.462450:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839645952:12345-0@lo:400:kworker.0 Request processed in 62us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687803.462458:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788687803.462461:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839646208:0@lo:400:kworker.0 00000100:00100000:1.0:1788687803.462500:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687803.462515:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839646464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687803.462520:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788687803.462525:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839645824:0@lo:400:kworker.0 00000100:00100000:1.0:1788687803.462546:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687803.462547:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687803.462563:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839646336:0@lo:400:kworker.0 00000100:00100000:1.0:1788687803.462583:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687803.462587:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839645952:0@lo:400:kworker.0 00000100:00100000:3.0:1788687803.462619:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839646464 00000100:00100000:3.0:1788687803.462623:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839646464 00000100:00100000:3.0:1788687803.462653:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788687803.462667:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839646464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788687803.462712:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788687803.462916:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687803.462919:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839646336 00000100:00080000:0.0:1788687803.462922:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687803.462923:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839646336 00000100:00100000:2.0:1788687803.462950:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788687803.462957:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839646080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687803.462959:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839645696 00000100:00100000:0.0:1788687803.462962:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839645696 00000100:00100000:0.0:1788687803.462997:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788687803.463006:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839645696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687803.463926:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839646464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1262us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687803.463937:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788687803.464023:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788687803.464035:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839646336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687803.464085:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839646336:12345-0@lo:400:kworker.0 Request processed in 53us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687803.464092:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788687803.464128:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839646208 00000100:00100000:1.0:1788687803.464134:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839646208 00000100:00100000:1.0:1788687803.464170:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839645824 00000100:00100000:1.0:1788687803.464174:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839645824 00000100:00100000:1.0:1788687803.464194:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788687803.464200:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839646208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687803.464221:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788687803.464231:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839645824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687803.464235:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839646208:12345-0@lo:400:kworker.0 Request processed in 35us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687803.464240:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788687803.464264:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839645824:12345-0@lo:400:kworker.0 Request processed in 36us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687803.464296:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839645824:0@lo:400:kworker.0 00000100:00100000:1.0:1788687803.464308:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788687803.464314:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3c315fb80, transno 4294967311 00000004:00080000:1.0:1788687803.464326:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788687803.464349:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839646336:0@lo:400:kworker.0 00000100:00100000:1.0:1788687803.464362:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839646208:0@lo:400:kworker.0 00000100:00100000:3.0:1788687803.464451:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788687803.464507:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788687803.464513:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788687803.464528:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3fba9b800, transno 4294967304 00000100:00100000:3.0:1788687803.464547:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839646464:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788687803.464804:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788687803.464809:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687803.465760:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839646080:12345-0@lo:400:kworker.0 Request processed in 2797us (3513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687803.465782:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788687803.465909:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839646080:0@lo:400:kworker.0 00000100:00100000:0.0:1788687803.466515:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839645696:12345-0@lo:400:kworker.0 Request processed in 3505us (4069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687803.466525:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788687803.466582:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839645696:0@lo:400:kworker.0 00010000:00010000:0.0:1788687803.909807:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687803.974505:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788687803.976543:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839646592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687803.976713:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687803.976877:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839646592 00000100:00100000:3.0:1788687803.976888:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839646592 00000100:00100000:3.0:1788687803.977966:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788687803.977984:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839646592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788687803.978041:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687803.978146:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839646592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687803.978155:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788687803.978556:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839646592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788687804.933914:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788687805.059220:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788687805.059318:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788687805.059340:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788687805.059355:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:1.0:1788687805.307458:0:12359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 05:43:23 (1788687803) 00000100:00100000:3.0:1788687805.419131:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687805.419184:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687805.419336:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687805.419377:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687805.419421:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687805.419460:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819715840 00000100:00100000:3.0:1788687805.419470:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819715840 00000100:00100000:3.0:1788687805.419577:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819715968 00000100:00100000:3.0:1788687805.419581:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819715968 00000100:00100000:3.0:1788687805.419612:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:3.0:1788687805.419624:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2347:x1875574819715840:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687805.420029:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819715584 00000100:00100000:1.0:1788687805.420044:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819715584 00000100:00100000:1.0:1788687805.420104:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 292 00000100:00100000:1.0:1788687805.420114:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819715584:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687805.420863:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:2.0:1788687805.420880:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819715968:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687805.421110:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2347:x1875574819715840:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1481us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687805.421133:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00080000:3.0:1788687805.421174:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788687805.421179:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788687805.426037:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819715584:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 5694us (6686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687805.426054:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 292 00000100:00100000:1.0:1788687805.426758:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819716096 00000100:00100000:1.0:1788687805.426785:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819716096 00000100:00100000:1.0:1788687805.426864:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819715712 00000100:00100000:1.0:1788687805.426868:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819715712 00000100:00100000:1.0:1788687805.426901:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 145 00000100:00100000:1.0:1788687805.426912:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee47b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+6:2347:x1875574819716096:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687805.426987:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee47b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+6:2347:x1875574819716096:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 76us (7770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687805.427012:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 145 00000100:00100000:1.0:1788687805.427037:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 146 00000100:00100000:1.0:1788687805.427045:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:2347:x1875574819715712:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687805.427094:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:2347:x1875574819715712:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 50us (7717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687805.427103:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 146 00000100:00100000:2.0:1788687805.427514:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819715968:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 6636us (8090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687805.427526:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00080000:2.0:1788687805.427570:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788687805.960062:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687806.393912:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687806.406258:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819716352 00000100:00100000:1.0:1788687806.406280:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819716352 00000100:00100000:1.0:1788687806.406388:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 137 00000100:00100000:1.0:1788687806.406401:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:11303:x1875574819716352:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687806.406430:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687806.406462:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449674 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.406609:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444967b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.406626:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444967b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.406642:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444967b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.406659:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449682 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.406666:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449682 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.406693:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449682 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407034:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449689 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407044:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449689 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407051:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449689 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687806.407062:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788687806.407246:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444967b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407256:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444967b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407263:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444967b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407270:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687806.407275:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444967b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407284:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444967b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407299:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9af3c7fb4c00) 00010000:00010000:1.0:1788687806.407302:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687806.407316:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444967b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407323:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444967b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407338:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449682 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407344:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449682 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407350:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449682 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407355:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cde00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687806.407357:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449682 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407362:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449682 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407369:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9af3c7fb4600) 00010000:00010000:1.0:1788687806.407371:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687806.407373:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449682 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407379:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449682 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.407968:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449674 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d34 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.408003:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449689 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d34 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687806.408011:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:1.0:1788687806.408014:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687806.408016:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd000, rc 0) 00000100:00100000:1.0:1788687806.408108:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:11303:x1875574819716352:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1709us (14211us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788687806.408118:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 137 00000100:00100000:3.0:1788687806.412405:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687806.412789:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819716480 00000100:00100000:1.0:1788687806.412805:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819716480 00000100:00100000:1.0:1788687806.412877:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 138 00000100:00100000:1.0:1788687806.412888:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:11303:x1875574819716480:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788687806.413024:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:11303:x1875574819716480:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 137us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687806.413032:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 138 00000100:00100000:3.0:1788687806.413440:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687806.414117:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819716608 00000100:00100000:0.0:1788687806.414128:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819716608 00000100:00100000:0.0:1788687806.414351:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:0.0:1788687806.414377:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:2346:x1875574819716608:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687806.414392:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687806.414419:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449689 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d34 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687806.414441:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:0.0:1788687806.414446:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687806.414581:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:2346:x1875574819716608:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 207us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687806.414590:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00010000:00010000:1.0:1788687806.982163:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788687807.110764:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687807.110777:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687807.110824:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788687807.110834:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788687808.007627:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687808.220782:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.220848:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819716736 00000100:00100000:3.0:1788687808.220859:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819716736 00000100:00100000:3.0:1788687808.220930:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 139 00000100:00100000:3.0:1788687808.220943:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:11346:x1875574819716736:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687808.220965:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687808.220988:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449697 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d3b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221071:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444969e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788687808.221163:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788687808.221198:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444969e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221211:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444969e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221228:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221235:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221242:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221836:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444969e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221845:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444969e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221852:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444969e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221858:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687808.221863:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444969e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221881:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444969e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221893:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:3.0:1788687808.221895:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687808.221900:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444969e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221906:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e7444969e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221917:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221923:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221929:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221934:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687808.221936:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221942:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221949:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9af3ca87c600) 00010000:00010000:3.0:1788687808.221951:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687808.221954:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.221968:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.222002:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449697 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d3b expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.222013:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:3.0:1788687808.222015:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687808.222019:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e74449697 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d3b expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.222028:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad600, rc 0) 00000100:00100000:3.0:1788687808.222100:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:11346:x1875574819716736:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1160us (1328us total) trans 0 rc 301/301 00000100:00100000:3.0:1788687808.222109:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 139 00000100:00100000:3.0:1788687808.225785:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687808.225932:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819716992 00000100:00100000:1.0:1788687808.225942:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819716992 00000100:00100000:1.0:1788687808.226007:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 140 00000100:00100000:1.0:1788687808.226018:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:11346:x1875574819716992:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:1.0:1788687808.226106:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687808.226135:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449015 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b74 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.226156:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:1.0:1788687808.226160:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687808.226413:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.226430:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d2d expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.226440:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.226504:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d2d expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.226519:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d2d expref: 5 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687808.226533:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839646720:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687808.226636:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788687808.233337:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.233393:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839646720:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687808.233612:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687808.236116:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819717120 00000100:00100000:0.0:1788687808.236127:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819717120 00010000:00010000:0.0:1788687808.236226:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d2d expref: 6 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687808.236268:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:0.0:1788687808.236279:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e3c77f5-0083-4021-afe4-5890473fab59+6:2348:x1875574819717120:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687808.236293:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687808.236300:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d2d expref: 6 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.236314:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d2d expref: 6 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.236335:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e7444966d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d2d expref: 6 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.236358:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:0.0:1788687808.236364:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.236375:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.236382:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.236403:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687808.236457:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2348:x1875574819717120:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 179us (3132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687808.236464:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00010000:00010000:3.0:1788687808.236752:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.236761:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.236783:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.236799:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.236807:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687808.237898:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788687808.237912:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.237922:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.237929:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.237934:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687808.237939:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.237948:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.237961:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736100) 00010000:00010000:3.0:1788687808.237964:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687808.237968:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.237974:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e744496ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788687808.238009:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084bbe8a9 reply state 000000002de1039d transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687808.238017:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788687808.238102:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:11346:x1875574819716992:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 12084us (12326us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788687808.238110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 140 00000100:00080000:1.0:1788687808.239457:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788687808.241782:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.241799:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.241808:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.241814:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687808.241819:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.241828:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.241846:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9af3ca87c600) 00010000:00010000:3.0:1788687808.241849:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687808.241854:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.241861:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496b3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687808.321062:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.321169:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819717248 00000100:00100000:3.0:1788687808.321180:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819717248 00000100:00100000:3.0:1788687808.321282:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 141 00000100:00100000:3.0:1788687808.321294:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:11354:x1875574819717248:12345-192.168.204.26@tcp:101:lctl.0 00010000:00010000:3.0:1788687808.321317:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687808.321341:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d42 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.321413:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744496c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.321428:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744496c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.321442:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744496c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687808.321520:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788687808.321524:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687808.321552:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744496c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.321589:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744496ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d42 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.321609:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744496c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d42 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.321617:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:3.0:1788687808.321635:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788687808.321639:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad600, rc 0) 00000100:00100000:2.0:1788687808.322984:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:11354:x1875574819717248:12345-192.168.204.26@tcp:101:lctl.0 Request processed in 1684us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687808.322997:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 141 00000100:00100000:1.0:1788687808.408396:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.413034:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819717376 00000100:00100000:3.0:1788687808.413051:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819717376 00000100:00100000:2.0:1788687808.413699:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 142 00000100:00100000:2.0:1788687808.413725:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+15:11360:x1875574819717376:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788687808.413745:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687808.413766:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744496c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d49 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.413832:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744496cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.413847:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744496cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.413859:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744496cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.413874:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744496d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.413882:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744496d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.413894:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744496d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.413987:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744496dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.413995:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744496dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414002:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744496dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687808.414039:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788687808.414043:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687808.414061:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744496dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414073:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744496cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414080:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744496cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414086:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744496cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414092:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687808.414097:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744496cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414104:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744496cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414115:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:2.0:1788687808.414118:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687808.414122:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744496cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414127:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744496cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414140:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744496d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414156:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744496d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414162:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744496d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414166:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687808.414169:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744496d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414175:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744496d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414182:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9af3e29feb00) 00010000:00010000:2.0:1788687808.414185:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687808.414187:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744496d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414193:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744496d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414222:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e744496c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d49 expref: 17 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414235:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744496dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d49 expref: 16 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.414242:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:2.0:1788687808.414244:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788687808.414251:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2c00, rc 0) 00000100:00100000:2.0:1788687808.414381:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:11360:x1875574819717376:12345-192.168.204.26@tcp:101:bash.0 Request processed in 659us (5996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687808.414398:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 142 00000100:00100000:0.0:1788687808.419242:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687808.419336:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819717632 00000100:00100000:1.0:1788687808.419347:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819717632 00000100:00100000:1.0:1788687808.419466:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 143 00000100:00100000:1.0:1788687808.419513:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:11360:x1875574819717632:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788687808.419537:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687808.419560:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744496e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d50 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.419711:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744496eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.419726:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744496eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.419737:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744496eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.419792:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.419800:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.419806:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788687808.420374:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788687808.420588:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420599:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420607:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420655:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744496eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420663:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744496eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420669:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744496eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420687:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687808.420692:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744496eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420700:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744496eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420714:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:1.0:1788687808.420718:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687808.420722:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744496eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420729:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744496eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788687808.420744:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062526b80 reply state 000000000a702926 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687808.420753:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788687808.420787:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744496e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d50 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420814:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d50 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.420821:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4700) 00010000:00010000:1.0:1788687808.420823:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687808.420826:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc400, rc 0) 00000100:00100000:1.0:1788687808.420904:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11360:x1875574819717632:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1429us (1729us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788687808.420913:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 143 00010000:00010000:0.0:1788687808.423187:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.423203:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.423210:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.423215:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687808.423219:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.423228:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.423259:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3c7fb4600) 00010000:00010000:0.0:1788687808.423262:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687808.423267:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.423273:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744496f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687808.424236:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687808.424276:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819717760 00000100:00100000:0.0:1788687808.424286:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819717760 00000100:00100000:0.0:1788687808.424350:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:0.0:1788687808.424363:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819717760:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788687808.424383:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687808.424403:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e74449707 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d57 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788687808.424446:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788687808.424468:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1788687808.424473:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687808.424613:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e74449707 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d57 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.424645:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e74449707 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d57 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.424667:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79eda00, rc 0) 00000100:00100000:0.0:1788687808.424738:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2346:x1875574819717760:12345-192.168.204.26@tcp:101:bash.0 Request processed in 378us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687808.424746:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00080000:0.0:1788687808.424769:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788687808.431768:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687808.432278:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819717888 00000100:00100000:2.0:1788687808.432289:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819717888 00000100:00100000:2.0:1788687808.432384:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:2.0:1788687808.432396:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:11360:x1875574819717888:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788687808.432416:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687808.432435:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d5e expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.432468:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e74449707 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d57 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.432477:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687808.432532:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687808.432539:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.432576:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e74449707 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d57 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.432589:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e74449707 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d57 expref: 7 pid: 6689 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687808.432602:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875574839646848:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687808.432725:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f159e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788687808.436269:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687808.436396:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875574839646848:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687808.436434:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.436464:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3c00, rc 0) 00000100:00100000:2.0:1788687808.436549:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:11360:x1875574819717888:12345-192.168.204.26@tcp:101:bash.0 Request processed in 4155us (4825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687808.436557:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:0.0:1788687808.437085:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819718016 00000100:00100000:0.0:1788687808.437093:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819718016 00010000:00010000:0.0:1788687808.437128:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e74449707 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d57 expref: 7 pid: 6689 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687808.437173:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1788687808.437183:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819718016:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687808.437196:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687808.437219:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e74449707 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d57 expref: 7 pid: 6689 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.437232:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e74449707 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d57 expref: 7 pid: 6689 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.437255:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e74449707 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d57 expref: 7 pid: 6689 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.437270:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687808.437274:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687808.437283:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.437312:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.437346:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687808.437360:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1875574839646976:192.168.204.26@tcp:105: 00000100:00100000:0.0:1788687808.437415:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687808.444122:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1875574839646976:192.168.204.26@tcp:105: 00010000:00010000:1.0:1788687808.444156:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687808.444185:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687808.444223:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819718016:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 7040us (7965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687808.444234:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:2.0:1788687808.444260:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819718272 00000100:00100000:2.0:1788687808.444269:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819718272 00000100:00100000:2.0:1788687808.444321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:2.0:1788687808.444336:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11360:x1875574819718272:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:2.0:1788687808.447812:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11360:x1875574819718272:12345-192.168.204.26@tcp:35:bash.0 Request processed in 3463us (3614us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788687808.447829:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:0.0:1788687808.525924:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687808.526078:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819718528 00000100:00100000:2.0:1788687808.526089:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819718528 00000100:00100000:2.0:1788687808.526152:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 144 00000100:00100000:2.0:1788687808.526163:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11370:x1875574819718528:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687808.526258:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687808.526281:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d65 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687808.526377:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788687808.526686:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449715 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d65 expref: 21 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.526720:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:2.0:1788687808.526723:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788687808.526729:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d65 expref: 21 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.526744:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2000, rc 0) 00000100:00100000:2.0:1788687808.526822:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11370:x1875574819718528:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 661us (907us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788687808.526830:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 144 00000100:00100000:0.0:1788687808.531845:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687808.532275:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819718784 00000100:00100000:1.0:1788687808.532286:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819718784 00000100:00100000:1.0:1788687808.532351:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:1.0:1788687808.532362:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11370:x1875574819718784:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788687808.532798:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:11370:x1875574819718784:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 436us (963us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788687808.532806:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:3.0:1788687808.583656:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839647488:0@lo:400:kworker.0 00000100:00100000:3.0:1788687808.583741:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687808.583805:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788687808.583812:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839647360:0@lo:400:kworker.0 00000100:00100000:3.0:1788687808.583840:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687808.583874:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839647488 00000100:00100000:3.0:1788687808.583882:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839647488 00000100:00100000:3.0:1788687808.583937:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788687808.583946:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839647488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687808.583996:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839647488:12345-0@lo:400:kworker.0 Request processed in 51us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687808.584004:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788687808.584046:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839647488:0@lo:400:kworker.0 00000100:00080000:3.0:1788687808.584077:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788687808.584088:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839647360 00000100:00100000:3.0:1788687808.584091:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839647360 00000100:00100000:3.0:1788687808.584122:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788687808.584129:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839647360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687808.584162:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839647360:12345-0@lo:400:kworker.0 Request processed in 35us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687808.584269:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839647104:0@lo:400:kworker.0 00000100:00100000:0.0:1788687808.584315:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687808.584342:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839647616:0@lo:400:kworker.0 00000100:00100000:0.0:1788687808.584366:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687808.584385:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788687808.584391:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839647232:0@lo:400:kworker.0 00000100:00100000:0.0:1788687808.584412:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687808.584428:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839647744:0@lo:400:kworker.0 00000100:00100000:0.0:1788687808.584446:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687808.584469:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839647104 00000100:00100000:0.0:1788687808.584473:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839647104 00000100:00100000:0.0:1788687808.584528:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788687808.584534:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839647104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687808.584565:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839647104:12345-0@lo:400:kworker.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687808.584582:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788687808.584616:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839647104:0@lo:400:kworker.0 00000100:00100000:0.0:1788687808.584635:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839647616 00000100:00100000:0.0:1788687808.584638:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839647616 00000100:00100000:0.0:1788687808.584656:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839647232 00000100:00100000:0.0:1788687808.584658:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839647232 00000100:00100000:0.0:1788687808.584682:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788687808.584690:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839647616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687808.584722:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839647616:12345-0@lo:400:kworker.0 Request processed in 34us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687808.584728:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788687808.584738:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788687808.584743:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839647232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687808.584766:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839647232:12345-0@lo:400:kworker.0 Request processed in 23us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687808.584771:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788687808.584791:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839647232:0@lo:400:kworker.0 00000100:00100000:0.0:1788687808.584799:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839647616:0@lo:400:kworker.0 00000100:00100000:3.0:1788687808.585392:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788687808.585427:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839647360:0@lo:400:kworker.0 00000100:00080000:3.0:1788687808.585446:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788687808.586092:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839647744 00000100:00100000:1.0:1788687808.586112:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839647744 00000100:00100000:1.0:1788687808.586164:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788687808.586183:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839647744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687808.586254:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839647744:12345-0@lo:400:kworker.0 Request processed in 73us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687808.586261:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788687808.586293:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839647744:0@lo:400:kworker.0 00000100:00100000:1.0:1788687808.586687:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839647872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687808.586728:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788687808.587857:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687808.587934:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839647872 00000100:00100000:2.0:1788687808.587942:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839647872 00000100:00100000:2.0:1788687808.587994:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788687808.588004:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839647872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788687808.588037:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687808.588241:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839647872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 238us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687808.588248:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788687808.588338:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839647872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687808.619008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687808.619133:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819718912 00000100:00100000:0.0:1788687808.619146:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819718912 00000100:00100000:0.0:1788687808.619215:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 145 00000100:00100000:0.0:1788687808.619227:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:11376:x1875574819718912:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687808.619254:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687808.619286:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e74449723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d6c expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.619351:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e7444972a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.619365:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e7444972a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.619377:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e7444972a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687808.619410:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788687808.619414:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687808.619430:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e7444972a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.619450:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e74449723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d6c expref: 23 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.619464:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e7444972a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d6c expref: 22 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.619470:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:0.0:1788687808.619472:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687808.619474:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79eda00, rc 0) 00000100:00100000:0.0:1788687808.619587:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:11376:x1875574819718912:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 362us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687808.619594:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 145 00000100:00100000:0.0:1788687808.622963:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.623049:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819719168 00000100:00100000:3.0:1788687808.623057:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819719168 00000100:00100000:3.0:1788687808.623106:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 146 00000100:00100000:3.0:1788687808.623117:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:11376:x1875574819719168:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687808.623136:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687808.623156:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449731 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d73 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.623264:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449738 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.623278:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.623290:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687808.623301:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788687808.623444:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449731 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d73 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.623461:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d73 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.623772:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4700) 00010000:00010000:3.0:1788687808.623776:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687808.623842:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac600, rc 0) 00000100:00100000:3.0:1788687808.624211:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11376:x1875574819719168:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1095us (1252us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788687808.624220:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 146 00000100:00100000:2.0:1788687808.629447:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687808.629717:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.629922:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819719424 00000100:00100000:3.0:1788687808.629933:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819719424 00000100:00100000:3.0:1788687808.629997:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 147 00000100:00100000:3.0:1788687808.630007:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11376:x1875574819719424:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687808.630032:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687808.630055:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449746 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d7a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687808.630347:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819719552 00000100:00100000:1.0:1788687808.630353:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819719552 00000100:00100000:1.0:1788687808.630396:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:1.0:1788687808.630412:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:2346:x1875574819719552:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687808.630424:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687808.630445:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449738 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d73 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.630462:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4700) 00010000:00010000:1.0:1788687808.630466:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687808.630546:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+25:2346:x1875574819719552:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 136us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687808.630554:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00010000:00010000:2.0:1788687808.631024:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444974d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.631041:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444974d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.631050:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444974d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687808.631082:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788687808.632439:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d7a expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.632465:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444974d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d7a expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.632474:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4700) 00010000:00010000:2.0:1788687808.632476:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788687808.632496:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3600, rc 0) 00000100:00100000:2.0:1788687808.632553:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+25:11376:x1875574819719424:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 2547us (3116us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788687808.632561:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 147 00000100:00100000:2.0:1788687808.637245:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.637329:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819719680 00000100:00100000:3.0:1788687808.637339:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819719680 00000100:00100000:3.0:1788687808.637390:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:3.0:1788687808.637400:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2349:x1875574819719680:12345-192.168.204.26@tcp:1:lfs.0 00010000:00010000:3.0:1788687808.637444:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.637464:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.637472:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687808.637516:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687808.637521:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.638058:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.638075:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 6 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687808.638091:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1875574839648000:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687808.638803:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788687808.641463:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.641469:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1875574839648000:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687808.641572:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819719808 00010000:00010000:3.0:1788687808.641578:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687808.641582:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819719808 00002000:00100000:2.0:1788687808.641722:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9af3ee90f100 x1875574819719808/t0(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:709/0 lens 504/0 e 0 to 0 dl 1788687819 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788687808.641734:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3ee90f100 with x1875574819719808 ext(0->12) 00010000:00010000:2.0:1788687808.641743:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 7 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.641759:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 7 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788687808.641766:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9af3ee90f100 00000100:00100000:2.0:1788687808.641815:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:2.0:1788687808.641826:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819719808:12345-192.168.204.26@tcp:4:lfs.0 00000100:00100000:2.0:1788687808.642763:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2348:x1875574819719808:12345-192.168.204.26@tcp:4:lfs.0 Request processed in 935us (1307us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788687808.642773:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00002000:00100000:2.0:1788687808.642952:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9af3ee90f100 x1875574819719808/t4294967305(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:709/0 lens 504/448 e 0 to 0 dl 1788687819 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788687808.642963:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3ee90f100 with x1875574819719808 ext(0->12) 00010000:00010000:2.0:1788687808.642971:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 9 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.643089:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 9 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788687808.643096:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9af3ee90f100 00000100:00100000:1.0:1788687808.646027:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.646185:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819719936 00000100:00100000:3.0:1788687808.646196:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819719936 00010000:00010000:3.0:1788687808.646240:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 9 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687808.646347:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:3.0:1788687808.646358:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2347:x1875574819719936:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687808.646375:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788687808.646392:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788687808.646394:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788687808 00002000:00010000:3.0:1788687808.646409:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788687808 00002000:00010000:3.0:1788687808.646411:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788687808 00010000:00010000:3.0:1788687808.646416:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 9 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.646426:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 9 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.646446:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e7444970e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d5e expref: 9 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.646461:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687808.646464:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687808.646469:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.646476:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.646544:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788687808.646560:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.646572:0:6689:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.646596:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.646605:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.646613:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.646620:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687808.646624:0:6689:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.646633:0:6689:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.646645:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.646653:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444975b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687808.646756:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819719680:12345-192.168.204.26@tcp:1:lfs.0 Request processed in 9357us (9520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687808.646766:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:0.0:1788687808.646800:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2347:x1875574819719936:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 445us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687808.646806:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:0.0:1788687808.650978:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687808.651036:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819720192 00000100:00100000:1.0:1788687808.651047:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819720192 00000100:00100000:1.0:1788687808.651122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:1.0:1788687808.651133:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b97450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+25:11376:x1875574819720192:12345-192.168.204.26@tcp:35:lfs.0 00000004:00010000:1.0:1788687808.651365:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444974d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d7a expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788687808.651882:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788687808.651924:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788687808.652389:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788687808.652581:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.652595:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d50 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.652602:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.652630:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d50 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.652642:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d50 expref: 29 pid: 5840 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687808.652652:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875574839648128:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687808.652741:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788687808.657784:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875574839648128:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687808.657820:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687808.658542:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687808.659293:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819720320 00000100:00100000:1.0:1788687808.659314:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819720320 00010000:00010000:1.0:1788687808.659358:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d50 expref: 30 pid: 5840 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687808.659402:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:1.0:1788687808.659413:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c690ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+30:2348:x1875574819720320:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687808.659427:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687808.659434:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d50 expref: 30 pid: 5840 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.659448:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d50 expref: 30 pid: 5840 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.659472:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e744496f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d50 expref: 30 pid: 5840 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.659521:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4700) 00010000:00010000:1.0:1788687808.659526:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.659536:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.659542:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.659587:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687808.659664:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c690ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:2348:x1875574819720320:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 253us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687808.659684:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00010000:00010000:0.0:1788687808.659916:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687808.659925:0:5842:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788687808.660392:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788687808.661422:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788687808.661839:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875574839648256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788687808.662085:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687808.662128:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788687808.664020:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839648256 00000100:00100000:3.0:1788687808.664034:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839648256 00000100:00100000:3.0:1788687808.664103:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788687808.664114:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875574839648256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788687808.664995:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875574839648256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 879us (2906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687808.665009:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788687808.665078:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875574839648256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788687808.666508:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788687808.666602:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e84700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875574839648384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788687808.666680:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687808.666715:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687808.666737:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839648384 00000100:00100000:1.0:1788687808.666744:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839648384 00000100:00100000:1.0:1788687808.666788:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788687808.666797:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875574839648384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788687808.666969:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875574839648384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 173us (300us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788687808.667147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788687808.667768:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e84700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875574839648384:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788687808.667832:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788687808.667873:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.667884:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.667892:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.667899:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687808.667904:0:5842:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.667912:0:5842:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.667926:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4700) 00010000:00010000:3.0:1788687808.667928:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788687808.667932:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.667938:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449762 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788687808.668133:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788687808.668257:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788687808.668268:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354358786785ns, next at 355358784920ns, rc = 0 00000001:00080000:3.0:1788687808.668284:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788687808.668311:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4700) 00010000:00010000:3.0:1788687808.668313:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788687808.668319:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444974d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d7a expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687808.668425:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b97450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:11376:x1875574819720192:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 17293us (17457us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788687808.668434:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000020:00080000:3.0:1788687808.668438:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788687808.670940:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687808.671159:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819720448 00000100:00100000:1.0:1788687808.671168:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819720448 00000100:00100000:1.0:1788687808.671227:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 148 00000100:00100000:1.0:1788687808.671238:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:11376:x1875574819720448:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687808.671263:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687808.671286:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449769 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d81 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.671345:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449769 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d81 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.671362:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449769 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d81 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.671382:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687808.671398:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687808.671403:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc400, rc 0) 00000100:00100000:1.0:1788687808.671554:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+33:11376:x1875574819720448:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 316us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687808.671561:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 148 00000100:00100000:0.0:1788687808.678021:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687808.678920:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819720704 00000100:00100000:2.0:1788687808.678931:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819720704 00000100:00100000:2.0:1788687808.679302:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:2.0:1788687808.679317:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+33:11376:x1875574819720704:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788687808.679898:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:11376:x1875574819720704:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 583us (1887us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788687808.679907:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:2.0:1788687808.761052:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687808.761173:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819720960 00000100:00100000:0.0:1788687808.761184:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819720960 00000100:00100000:0.0:1788687808.761250:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 149 00000100:00100000:0.0:1788687808.761261:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:11386:x1875574819720960:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687808.761285:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687808.761307:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449770 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d88 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687808.761424:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788687808.762200:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449770 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d88 expref: 36 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.762218:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:1.0:1788687808.762222:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788687808.762227:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449770 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d88 expref: 36 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.762241:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ede00, rc 0) 00000100:00100000:1.0:1788687808.762348:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+35:11386:x1875574819720960:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1088us (1305us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1788687808.762357:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 149 00000100:00100000:0.0:1788687808.767415:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687808.767853:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819721088 00000100:00100000:1.0:1788687808.767865:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819721088 00000100:00100000:1.0:1788687808.767972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 150 00000100:00100000:1.0:1788687808.767984:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+35:11386:x1875574819721088:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:1.0:1788687808.768073:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444977e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768090:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444977e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768110:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444977e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768141:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768150:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768157:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768265:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768275:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768282:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788687808.768324:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768338:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444977e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768345:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444977e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768352:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444977e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768358:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687808.768362:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444977e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768378:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444977e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768391:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:1.0:1788687808.768394:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687808.768398:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444977e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768405:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444977e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768419:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768425:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449785 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768432:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768437:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687808.768440:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768446:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449785 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768453:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687808.768456:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687808.768459:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449785 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768475:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768530:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768536:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768541:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768939:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687808.768943:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768950:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768959:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687808.768961:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687808.768965:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687808.768971:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444978c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687808.769072:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+35:11386:x1875574819721088:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 1090us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687808.769080:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 150 00000100:00100000:0.0:1788687808.771388:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.771473:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819721344 00000100:00100000:3.0:1788687808.771506:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819721344 00000100:00100000:3.0:1788687808.771568:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:3.0:1788687808.771579:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+35:11386:x1875574819721344:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:3.0:1788687808.771941:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:11386:x1875574819721344:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 363us (561us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788687808.771949:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:3.0:1788687808.801451:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687808.803045:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819721600 00000100:00100000:2.0:1788687808.803059:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819721600 00000100:00100000:2.0:1788687808.803148:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 151 00000100:00100000:2.0:1788687808.803159:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:11389:x1875574819721600:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687808.803185:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687808.803205:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449793 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803304:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e7444979a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803320:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e7444979a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803331:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e7444979a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803346:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744497a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803353:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744497a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803359:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744497a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803473:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803510:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803518:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687808.803537:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788687808.803647:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e7444979a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803655:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e7444979a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803661:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e7444979a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803707:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687808.803712:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e7444979a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803722:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e7444979a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803733:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:2.0:1788687808.803736:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687808.803740:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e7444979a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803745:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e7444979a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803758:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744497a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803763:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744497a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803778:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744497a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803783:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687808.803785:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744497a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803791:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744497a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803798:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3e29feb00) 00010000:00010000:2.0:1788687808.803800:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687808.803803:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744497a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803808:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e744497a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803849:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449793 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d8f expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803864:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d8f expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687808.803870:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:2.0:1788687808.803872:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687808.803874:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2600, rc 0) 00000100:00100000:2.0:1788687808.803942:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:11389:x1875574819721600:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 784us (2498us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788687808.803959:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 151 00000100:00100000:0.0:1788687808.808174:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687808.808545:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819721728 00000100:00100000:3.0:1788687808.808558:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819721728 00000100:00100000:3.0:1788687808.808617:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 152 00000100:00100000:3.0:1788687808.808630:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:11389:x1875574819721728:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788687808.808774:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.808794:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.808825:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.808855:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.808863:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.808871:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.808877:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687808.808882:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.808891:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.808905:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687808.808908:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788687808.808912:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687808.808919:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687808.809306:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:11389:x1875574819721728:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 679us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687808.809316:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 152 00000100:00100000:0.0:1788687808.814725:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687808.815114:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819721984 00000100:00100000:2.0:1788687808.815126:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819721984 00000100:00100000:2.0:1788687808.815189:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:2.0:1788687808.815199:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:11389:x1875574819721984:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788687808.815434:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+39:11389:x1875574819721984:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 235us (952us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788687808.815442:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00010000:00010000:1.0:1788687809.029988:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687809.094081:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839648512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687809.094171:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687809.094308:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839648512 00000100:00100000:0.0:1788687809.094316:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839648512 00000100:00100000:0.0:1788687809.094370:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788687809.094380:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839648512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788687809.094419:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687809.094476:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839648512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687809.094506:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788687809.094607:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839648512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687809.105972:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.106058:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819722240 00000100:00100000:3.0:1788687809.106069:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819722240 00000100:00100000:3.0:1788687809.106139:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 153 00000100:00100000:3.0:1788687809.106150:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+39:11420:x1875574819722240:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:3.0:1788687809.106185:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687809.106207:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d96 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.106313:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744497c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.106330:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744497c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.106341:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744497c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687809.106353:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788687809.106530:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d96 expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.106550:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744497c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d96 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.106559:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687809.106562:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687809.106566:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad400, rc 0) 00000100:00100000:3.0:1788687809.106627:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:11420:x1875574819722240:12345-192.168.204.26@tcp:101:cat.0 Request processed in 478us (666us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788687809.106648:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 153 00000100:00100000:0.0:1788687809.115474:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.115791:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819722496 00000100:00100000:0.0:1788687809.115796:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.115802:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819722496 00000100:00100000:3.0:1788687809.115861:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:3.0:1788687809.115872:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:11420:x1875574819722496:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:1.0:1788687809.115932:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819722624 00000100:00100000:1.0:1788687809.115936:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819722624 00000100:00100000:1.0:1788687809.115973:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:1.0:1788687809.115980:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+42:2346:x1875574819722624:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687809.115991:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687809.116015:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744497c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d96 expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.116032:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687809.116037:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687809.116089:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+42:11420:x1875574819722496:12345-192.168.204.26@tcp:35:cat.0 Request processed in 218us (625us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788687809.116089:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+42:2346:x1875574819722624:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 108us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687809.116097:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:1.0:1788687809.116097:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:2.0:1788687809.179606:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687809.179909:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819722880 00000100:00100000:1.0:1788687809.179920:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819722880 00000100:00100000:1.0:1788687809.179985:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 154 00000100:00100000:1.0:1788687809.179997:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:11426:x1875574819722880:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1788687809.180020:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687809.180024:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788687809.180052:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e7444972a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d6c expref: 41 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.180073:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:1.0:1788687809.180078:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687809.180114:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744497d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462d9d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.180275:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.180290:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d8f expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.180299:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.180333:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d8f expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.180348:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d8f expref: 41 pid: 5839 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687809.180361:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839648640:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687809.180554:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788687809.184684:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839648640:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687809.184718:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687809.186885:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.189449:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819723008 00000100:00100000:3.0:1788687809.189465:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819723008 00010000:00010000:3.0:1788687809.189548:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d8f expref: 42 pid: 5839 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687809.189596:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:3.0:1788687809.189607:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+42:2349:x1875574819723008:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687809.189622:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687809.189629:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d8f expref: 42 pid: 5839 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.189651:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d8f expref: 42 pid: 5839 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.189698:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744497a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d8f expref: 42 pid: 5839 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.189717:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687809.189737:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.189756:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.189764:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.189804:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687809.189872:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:2349:x1875574819723008:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 267us (2995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687809.189881:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00010000:00010000:2.0:1788687809.189919:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.189933:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687809.189954:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788687809.190089:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744497d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d9d expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.190108:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d9d expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.190128:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:2.0:1788687809.190131:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788687809.190134:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cce00, rc 0) 00000100:00100000:2.0:1788687809.190161:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:11426:x1875574819722880:12345-192.168.204.26@tcp:101:dd.0 Request processed in 10167us (10565us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788687809.190168:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 154 00000100:00100000:1.0:1788687809.194730:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.194846:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819723264 00000100:00100000:3.0:1788687809.194857:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819723264 00000100:00100000:3.0:1788687809.194966:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 155 00000100:00100000:3.0:1788687809.194978:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+41:11426:x1875574819723264:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:3.0:1788687809.195269:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.195289:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.195306:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788687809.195373:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788687809.195399:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054c86eed reply state 00000000e4cb869f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687809.195408:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788687809.195698:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+44:11426:x1875574819723264:12345-192.168.204.26@tcp:36:dd.0 Request processed in 722us (978us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788687809.195707:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 155 00000020:00080000:3.0:1788687809.195711:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788687809.200269:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.200288:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.200297:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.200303:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687809.200308:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.200317:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.200341:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687809.200344:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687809.200349:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.200355:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687809.453060:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.453319:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819723392 00000100:00100000:3.0:1788687809.453330:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819723392 00000100:00100000:3.0:1788687809.453396:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 156 00000100:00100000:3.0:1788687809.453407:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+43:11440:x1875574819723392:12345-192.168.204.26@tcp:101:stat.0 00010000:00010000:3.0:1788687809.453450:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687809.453472:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462da4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453590:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744497f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453606:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744497f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453619:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744497f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453634:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744497fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453641:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744497fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453648:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744497fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453755:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453775:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d9d expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453785:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453822:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d9d expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.453843:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d9d expref: 44 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687809.453859:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839648768:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687809.453980:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788687809.457716:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839648768:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687809.457749:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687809.458946:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.459201:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819723648 00000100:00100000:3.0:1788687809.459210:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819723648 00000100:00100000:3.0:1788687809.459273:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:3.0:1788687809.459283:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+45:5584:x1875574819723648:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788687809.460321:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+46:5584:x1875574819723648:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 1034us (1376us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788687809.460341:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:0.0:1788687809.469511:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687809.473753:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819723776 00000100:00100000:1.0:1788687809.473779:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819723776 00010000:00010000:1.0:1788687809.473832:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d9d expref: 46 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687809.473886:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:1.0:1788687809.473909:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+46:2349:x1875574819723776:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687809.473933:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687809.473940:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d9d expref: 46 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.473954:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d9d expref: 46 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.473976:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744497d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d9d expref: 46 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.473992:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687809.473998:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.474007:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.474014:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.474053:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687809.474123:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+45:2349:x1875574819723776:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 213us (4652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687809.474130:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00010000:00010000:3.0:1788687809.477407:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477425:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687809.477509:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788687809.477515:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687809.477550:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477587:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477598:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744497f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477605:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744497f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477612:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744497f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477618:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687809.477623:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744497f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477632:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744497f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477647:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:3.0:1788687809.477662:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687809.477667:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744497f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477674:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744497f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477687:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744497fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477693:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744497fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477704:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744497fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477709:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687809.477711:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744497fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477718:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744497fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477727:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3ca87ca00) 00010000:00010000:3.0:1788687809.477730:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687809.477733:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744497fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477738:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744497fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477784:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744497ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462da4 expref: 45 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477798:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462da4 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.477806:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687809.477808:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687809.477811:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad400, rc 0) 00000100:00100000:3.0:1788687809.477883:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+44:11440:x1875574819723392:12345-192.168.204.26@tcp:101:stat.0 Request processed in 24478us (24838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687809.477900:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 156 00000100:00100000:0.0:1788687809.588332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687809.588454:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819724032 00000100:00100000:1.0:1788687809.588467:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819724032 00000100:00100000:1.0:1788687809.588566:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 157 00000100:00100000:1.0:1788687809.588577:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+44:11446:x1875574819724032:12345-192.168.204.26@tcp:36:truncate.0 00010000:00010000:1.0:1788687809.588643:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687809.588686:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462da4 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.588709:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687809.588715:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687809.589005:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.589020:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.589031:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788687809.589083:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1788687809.589109:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c4759b1 reply state 00000000d988eb1f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687809.589120:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788687809.589267:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+46:11446:x1875574819724032:12345-192.168.204.26@tcp:36:truncate.0 Request processed in 691us (947us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788687809.589276:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 157 00000020:00080000:1.0:1788687809.589280:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788687809.593345:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.593366:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.593374:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.593381:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687809.593387:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.593397:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.593421:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:2.0:1788687809.593424:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687809.593428:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.593434:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e7444980a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687809.774855:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687809.776247:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819724160 00000100:00100000:2.0:1788687809.776262:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819724160 00000100:00100000:2.0:1788687809.776360:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 158 00000100:00100000:2.0:1788687809.776371:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+45:11460:x1875574819724160:12345-192.168.204.26@tcp:101:stat.0 00010000:00010000:2.0:1788687809.776811:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687809.776835:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74449811 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462dab expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.777632:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449818 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.777659:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.777672:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.777689:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e7444981f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.777696:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e7444981f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.777703:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e7444981f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.777788:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.777796:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.777817:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687809.780221:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788687809.780233:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687809.780273:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780294:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780306:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780314:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449818 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780321:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449818 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780327:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687809.780332:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449818 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780339:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449818 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780356:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:2.0:1788687809.780359:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687809.780363:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449818 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780496:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449818 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780520:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e7444981f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780527:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e7444981f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780534:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e7444981f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780539:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687809.780543:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e7444981f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780549:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e7444981f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780558:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3e29feb00) 00010000:00010000:2.0:1788687809.780561:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687809.780564:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e7444981f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780570:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e7444981f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780618:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2200/0xc2ddd83e74449811 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dab expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.780634:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dab expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.781880:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:2.0:1788687809.781884:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687809.781888:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3800, rc 0) 00000100:00100000:2.0:1788687809.781979:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+46:11460:x1875574819724160:12345-192.168.204.26@tcp:101:stat.0 Request processed in 5606us (7141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687809.781988:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 158 00000100:00100000:0.0:1788687809.852713:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.852854:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819724416 00000100:00100000:3.0:1788687809.852866:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819724416 00000100:00100000:3.0:1788687809.852973:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 159 00000100:00100000:3.0:1788687809.852986:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+46:11470:x1875574819724416:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687809.853013:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687809.853039:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444982d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462db2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687809.853183:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788687809.853467:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444982d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db2 expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.853511:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:3.0:1788687809.853515:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788687809.853521:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444982d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db2 expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.853540:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac800, rc 0) 00000100:00100000:3.0:1788687809.853677:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:11470:x1875574819724416:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 694us (980us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788687809.853686:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 159 00000100:00100000:1.0:1788687809.858722:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687809.858964:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819724672 00000100:00100000:0.0:1788687809.858981:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819724672 00000100:00100000:0.0:1788687809.859052:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:0.0:1788687809.859063:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b91c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:11470:x1875574819724672:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788687809.859775:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b91c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+48:11470:x1875574819724672:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 710us (1065us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788687809.859807:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:0.0:1788687809.923951:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.924043:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819724928 00000100:00100000:3.0:1788687809.924056:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819724928 00000100:00100000:3.0:1788687809.924238:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 160 00000100:00100000:3.0:1788687809.924250:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+48:11476:x1875574819724928:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788687809.924307:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687809.924394:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444983b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462db9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.925001:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.925022:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dab expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.925032:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.925079:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dab expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.925097:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dab expref: 49 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687809.925114:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839648896:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687809.925278:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687809.932803:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.933285:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839648896:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687809.933325:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687809.933412:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819725056 00000100:00100000:0.0:1788687809.933423:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819725056 00010000:00010000:0.0:1788687809.933476:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dab expref: 50 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687809.934152:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:0.0:1788687809.934166:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+50:2348:x1875574819725056:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687809.934189:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687809.934197:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dab expref: 50 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687809.934211:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dab expref: 50 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687809.934242:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dab expref: 50 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687809.934266:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:0.0:1788687809.934271:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687809.934283:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687809.934305:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687809.934365:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687809.934455:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+49:2348:x1875574819725056:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 293us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687809.934464:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00010000:00010000:3.0:1788687809.934727:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.934737:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687809.934770:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788687809.934988:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e7444983b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db9 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.935007:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db9 expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.935016:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687809.935019:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788687809.935022:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac600, rc 0) 00000100:00100000:3.0:1788687809.935058:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+49:11476:x1875574819724928:12345-192.168.204.26@tcp:101:bash.0 Request processed in 10811us (11124us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788687809.935066:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 160 00000100:00100000:1.0:1788687809.939161:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687809.939266:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819725312 00000100:00100000:2.0:1788687809.939278:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819725312 00000100:00100000:2.0:1788687809.939377:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 161 00000100:00100000:2.0:1788687809.939392:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+49:11476:x1875574819725312:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:2.0:1788687809.939799:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.939831:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.939851:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788687809.939905:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788687809.939928:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e735cc90 reply state 00000000e2cb3fd1 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687809.939938:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788687809.940051:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:11476:x1875574819725312:12345-192.168.204.26@tcp:36:bash.0 Request processed in 663us (903us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788687809.940059:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 161 00000020:00080000:2.0:1788687809.940086:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788687809.942187:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.942207:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.942215:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.942222:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687809.942297:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.942308:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.942351:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687809.942354:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687809.942360:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.942368:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449850 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687809.947737:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687809.948299:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819725440 00000100:00100000:2.0:1788687809.948313:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819725440 00000100:00100000:2.0:1788687809.948394:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 162 00000100:00100000:2.0:1788687809.948410:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:11476:x1875574819725440:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788687809.948443:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687809.948470:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e74449857 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462dc0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.948767:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.948786:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db9 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.948797:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.948839:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db9 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687809.948854:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db9 expref: 52 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687809.948871:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c50700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839649024:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687809.949028:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f159e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788687809.953303:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.953361:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819725568 00000100:00100000:3.0:1788687809.953373:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819725568 00010000:00010000:3.0:1788687809.953429:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db9 expref: 53 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687809.953517:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c50700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839649024:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687809.953548:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00010000:00010000:1.0:1788687809.953553:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687809.953560:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:2349:x1875574819725568:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687809.953578:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687809.953586:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db9 expref: 53 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.953600:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db9 expref: 53 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.953628:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449842 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462db9 expref: 53 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.953658:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687809.953664:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.953684:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.953693:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687809.953724:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687809.953801:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:2349:x1875574819725568:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 243us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687809.953808:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00010000:00010000:1.0:1788687809.954007:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.954016:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687809.954078:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788687809.954083:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687809.954111:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.954149:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3000/0xc2ddd83e74449857 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dc0 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.954167:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dc0 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687809.954176:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687809.954179:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687809.954182:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3e00, rc 0) 00000100:00100000:1.0:1788687809.954267:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:11476:x1875574819725440:12345-192.168.204.26@tcp:101:bash.0 Request processed in 5863us (6545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687809.954275:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 162 00000100:00100000:2.0:1788687809.958057:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687809.958942:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819725824 00000100:00100000:3.0:1788687809.958960:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819725824 00000100:00100000:3.0:1788687809.959030:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:3.0:1788687809.959043:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:11476:x1875574819725824:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:2.0:1788687809.960214:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:11476:x1875574819725824:12345-192.168.204.26@tcp:35:bash.0 Request processed in 1162us (2161us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788687809.960257:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:0.0:1788687810.024918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687810.025183:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819726080 00000100:00100000:3.0:1788687810.025195:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819726080 00000100:00100000:3.0:1788687810.025302:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 163 00000100:00100000:3.0:1788687810.025316:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:11486:x1875574819726080:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687810.025352:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687810.025392:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462dc7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687810.025570:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788687810.025768:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449865 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dc7 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.025786:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:3.0:1788687810.025810:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788687810.025818:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dc7 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.025836:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac600, rc 0) 00000100:00100000:3.0:1788687810.025916:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:11486:x1875574819726080:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 603us (1013us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1788687810.025925:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 163 00000100:00080000:0.0:1788687810.026000:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687810.029087:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687810.029891:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819726208 00000100:00100000:2.0:1788687810.029905:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819726208 00000100:00100000:2.0:1788687810.029990:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 164 00000100:00100000:2.0:1788687810.030003:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:11486:x1875574819726208:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:2.0:1788687810.030116:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449873 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030138:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449873 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030155:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449873 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030175:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444987a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030183:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444987a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030190:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444987a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030311:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030321:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030328:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788687810.030400:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030416:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449873 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030422:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449873 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030429:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030434:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687810.030439:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030447:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449873 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030460:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:2.0:1788687810.030463:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687810.030468:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449873 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030474:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449873 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030529:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444987a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030535:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444987a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030548:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444987a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030553:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687810.030556:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444987a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030562:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444987a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030570:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3e29feb00) 00010000:00010000:2.0:1788687810.030573:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687810.030576:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444987a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030581:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444987a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030598:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030605:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030611:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.030617:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687810.030619:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.033061:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.033084:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:2.0:1788687810.033087:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687810.033094:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.033101:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687810.033246:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:11486:x1875574819726208:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 3239us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687810.033258:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 164 00000100:00100000:2.0:1788687810.037032:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687810.037296:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819726464 00000100:00100000:0.0:1788687810.037310:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819726464 00000100:00100000:0.0:1788687810.037382:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:0.0:1788687810.037394:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+53:11486:x1875574819726464:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788687810.038046:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:11486:x1875574819726464:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 651us (1025us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788687810.038291:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00010000:00010000:2.0:1788687810.055295:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687810.075993:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687810.076148:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819726720 00000100:00100000:2.0:1788687810.076161:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819726720 00000100:00100000:2.0:1788687810.076231:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 165 00000100:00100000:2.0:1788687810.076245:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:11489:x1875574819726720:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687810.076277:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687810.076302:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449888 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462dce expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.076396:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444988f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.076414:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444988f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.076443:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444988f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.076460:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449896 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.076467:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.076473:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.078226:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444989d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.078250:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444989d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.078263:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444989d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687810.078276:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788687810.078401:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444988f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.078409:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444988f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.078417:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444988f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.078424:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687810.078443:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444988f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.078452:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444988f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.078467:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:2.0:1788687810.078470:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687810.078474:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444988f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.079936:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e7444988f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.079965:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.079974:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.079981:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.079986:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687810.079990:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.079997:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.080012:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3e29feb00) 00010000:00010000:2.0:1788687810.080015:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687810.080376:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449896 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.080384:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449896 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.080470:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449888 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dce expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.080535:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444989d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dce expref: 56 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.080544:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:2.0:1788687810.080547:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687810.080550:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3c00, rc 0) 00000100:00100000:2.0:1788687810.080660:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:11489:x1875574819726720:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 4415us (4681us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788687810.080671:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 165 00000100:00100000:1.0:1788687810.087408:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687810.087473:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687810.087659:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819726848 00000100:00100000:0.0:1788687810.087672:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819726848 00000100:00100000:2.0:1788687810.087831:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819726976 00000100:00100000:2.0:1788687810.087837:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819726976 00000100:00100000:2.0:1788687810.087889:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 166 00000100:00100000:2.0:1788687810.087900:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+57:11489:x1875574819726976:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:2.0:1788687810.087995:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.088015:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.088029:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687810.088041:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788687810.088053:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+57:2348:x1875574819726848:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687810.088085:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687810.088109:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e7444989d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dce expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687810.088131:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:0.0:1788687810.088137:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687810.088222:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:2348:x1875574819726848:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 172us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687810.088231:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00010000:00010000:2.0:1788687810.088997:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.089017:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.089024:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.089031:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687810.089036:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.089043:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.089063:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:2.0:1788687810.089066:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788687810.089071:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.089078:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687810.089211:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:11489:x1875574819726976:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 1308us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687810.089223:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 166 00000100:00100000:1.0:1788687810.094766:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687810.095836:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819727232 00000100:00100000:2.0:1788687810.095852:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819727232 00000100:00100000:2.0:1788687810.095975:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:2.0:1788687810.096010:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:11489:x1875574819727232:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788687810.096593:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:11489:x1875574819727232:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 584us (1840us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788687810.096603:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00000001:00080000:2.0:1788687810.174877:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000001:00080000:2.0:1788687810.175105:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:2.0:1788687810.175355:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788687810.175593:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9af3fc1c1900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788687810.175599:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3c82a2f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9af3fc1c1240 00000020:00080000:2.0:1788687810.175602:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3c82a2300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9af3fc1a4000 00000020:00080000:0.0:1788687810.175634:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788687810.175848:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788687810.176030:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839649152:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788687810.176126:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687810.176242:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839649152 00000100:00100000:0.0:1788687810.176250:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839649152 00000100:00100000:0.0:1788687810.176308:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788687810.176318:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839649152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788687810.176347:0:8309:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788687810.176382:0:8309:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9d35c0, atime: 0x6a9d35c0, ctime: 0x6a9d35c0, blocks: 0x1 00010000:00010000:0.0:1788687810.176390:0:8309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e744498b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687810.176409:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1788687810.176414:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687810.176421:0:8309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e744498b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687810.176438:0:8309:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e744498b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687810.176449:0:8309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e744498b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687810.176457:0:8309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e744498b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687810.176508:0:8309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788687810.177752:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839649152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1431us (1621us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788687810.177762:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788687810.177791:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788687810.177976:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3f3415c00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788687810.177983:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839649152:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788687810.178007:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687810.178014:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e744498b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687810.178025:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eda00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687810.178030:0:5828:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e744498b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687810.178040:0:5828:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e744498b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687810.178063:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e744498b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687810.178070:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b6d16d4/0xc2ddd83e744498b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687810.178092:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687810.178095:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687810.178096:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687810.206225:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687810.206381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819727488 00000100:00100000:3.0:1788687810.206391:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819727488 00000100:00100000:3.0:1788687810.206457:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:3.0:1788687810.206468:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+16:11507:x1875574819727488:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:3.0:1788687810.206532:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687810.206553:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462dd5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.206666:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.206682:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.206694:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687810.206705:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788687810.206950:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dd5 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.206988:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dd5 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.206996:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687810.207000:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788687810.207003:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac800, rc 0) 00000100:00100000:3.0:1788687810.207072:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11507:x1875574819727488:12345-192.168.204.26@tcp:101:cat.0 Request processed in 606us (858us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788687810.207080:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:1.0:1788687810.242663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687810.243880:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819727616 00000100:00100000:2.0:1788687810.243896:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819727616 00000100:00100000:2.0:1788687810.243986:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 168 00000100:00100000:2.0:1788687810.243999:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11508:x1875574819727616:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687810.244027:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687810.244050:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ddc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.244124:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744498d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.244140:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744498d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.244152:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744498d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687810.244203:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788687810.244221:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687810.244244:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744498d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.244273:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ddc expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.244294:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744498d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ddc expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.244303:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:2.0:1788687810.244306:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687810.244310:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2400, rc 0) 00000100:00100000:2.0:1788687810.244386:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11508:x1875574819727616:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 389us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687810.244394:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 168 00000100:00100000:1.0:1788687810.248977:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687810.249892:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819728000 00000100:00100000:0.0:1788687810.249913:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819728000 00000100:00100000:0.0:1788687810.251286:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:0.0:1788687810.251312:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11508:x1875574819728000:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788687810.251854:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11508:x1875574819728000:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 551us (2887us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788687810.251864:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:0.0:1788687810.254841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687810.255273:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819728128 00000100:00100000:3.0:1788687810.255287:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819728128 00000100:00100000:3.0:1788687810.255384:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:3.0:1788687810.255397:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c6909c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11508:x1875574819728128:12345-192.168.204.26@tcp:103:lfs.0 00010000:00010000:3.0:1788687810.255418:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788687810.255459:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444985e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dc0 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.256960:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dd5 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.256992:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449769 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d81 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.257008:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687810.257024:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687810.257339:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c6909c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:11508:x1875574819728128:12345-192.168.204.26@tcp:103:lfs.0 Request processed in 1943us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687810.257351:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:1.0:1788687810.267023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687810.267273:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819728256 00000100:00100000:3.0:1788687810.267288:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819728256 00000100:00100000:3.0:1788687810.267376:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00100000:3.0:1788687810.267391:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:11508:x1875574819728256:12345-192.168.204.26@tcp:58:lfs.0 00010000:00010000:3.0:1788687810.268908:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.268944:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687810.268960:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788687810.269425:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788687810.269811:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:11508:x1875574819728256:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 2417us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687810.269825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00100000:1.0:1788687810.303774:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687810.304856:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819728384 00000100:00100000:2.0:1788687810.304876:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819728384 00000100:00100000:2.0:1788687810.304980:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 170 00000100:00100000:2.0:1788687810.304994:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:11510:x1875574819728384:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788687810.305027:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687810.305058:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462de3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.305154:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744498ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.305172:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744498ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.305211:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744498ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.305231:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744498f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.305240:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744498f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.305247:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744498f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.305951:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.305965:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.305975:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687810.306026:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788687810.306031:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687810.306056:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306071:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306081:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744498ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306098:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744498ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306106:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744498ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306113:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687810.306118:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744498ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306127:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744498ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306143:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:2.0:1788687810.306146:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687810.306152:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744498ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306158:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3600/0xc2ddd83e744498ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306173:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744498f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306180:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744498f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306186:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744498f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306192:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687810.306200:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744498f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306208:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744498f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306216:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3e29feb00) 00010000:00010000:2.0:1788687810.306219:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687810.306222:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744498f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306228:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e744498f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306272:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e744498e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462de3 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306288:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462de3 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687810.306297:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ca00) 00010000:00010000:2.0:1788687810.306299:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687810.306302:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2e00, rc 0) 00000100:00100000:2.0:1788687810.306401:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11510:x1875574819728384:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1409us (2637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687810.306411:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 170 00000100:00100000:0.0:1788687810.538045:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687810.538289:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687810.538327:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687810.538359:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819728768 00000100:00100000:0.0:1788687810.538369:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819728768 00000100:00100000:0.0:1788687810.538430:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819728640 00000100:00100000:0.0:1788687810.538434:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819728640 00000100:00100000:0.0:1788687810.538461:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:0.0:1788687810.538472:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819728768:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687810.538567:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2347:x1875574819728768:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 97us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687810.538575:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:0.0:1788687810.538603:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:0.0:1788687810.538610:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2347:x1875574819728640:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687810.538649:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2347:x1875574819728640:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 39us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687810.538656:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00080000:0.0:1788687810.538671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788687810.538676:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788687810.538826:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819728512 00000100:00100000:1.0:1788687810.538830:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819728512 00000100:00100000:1.0:1788687810.538865:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 294 00000100:00100000:1.0:1788687810.538880:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819728512:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687810.538910:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819728512:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 39us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687810.538916:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 294 00000100:00100000:1.0:1788687810.540137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687810.542580:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819728896 00000100:00100000:3.0:1788687810.542596:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819728896 00000100:00100000:3.0:1788687810.542733:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 150 00000100:00100000:3.0:1788687810.542744:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819728896:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687810.542821:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2346:x1875574819728896:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 78us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687810.542828:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 150 00000100:00080000:1.0:1788687810.549674:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788687811.052889:0:12507:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788687811.052904:0:12507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788687811.052956:0:12507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788687811.052963:0:12507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788687811.079453:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788687811.210205:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687811.210214:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687811.210265:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788687811.210273:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788687811.210402:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3eace00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839649280:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788687811.210517:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c858e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687811.230100:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687811.230171:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819729024 00000100:00100000:3.0:1788687811.230181:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819729024 00000100:00100000:3.0:1788687811.230240:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 171 00000100:00100000:3.0:1788687811.230251:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11522:x1875574819729024:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000100:00100000:2.0:1788687811.230263:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3eace00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839649280:192.168.204.26@tcp:107:hsm_cdtr.0 00000004:00000080:3.0:1788687811.230280:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788687811.230385:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11522:x1875574819729024:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 135us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687811.230392:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 171 00000100:00100000:1.0:1788687811.234787:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687811.234998:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819729152 00000100:00100000:3.0:1788687811.235010:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819729152 00000100:00100000:3.0:1788687811.235077:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 172 00000100:00100000:3.0:1788687811.235088:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11522:x1875574819729152:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788687811.235181:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235198:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235211:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235227:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449906 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235234:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449906 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235255:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449906 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235283:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235292:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235299:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687811.235336:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788687811.235340:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687811.235354:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235365:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235372:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235378:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235384:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687811.235388:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235394:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235414:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:3.0:1788687811.235417:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687811.235422:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235428:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744498ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235442:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449906 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235447:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449906 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235452:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449906 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235456:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687811.235458:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449906 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235463:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449906 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235569:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9af3ca87c400) 00010000:00010000:3.0:1788687811.235572:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687811.235574:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449906 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235580:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449906 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235609:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235614:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235629:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235635:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687811.235638:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235644:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235652:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ca00) 00010000:00010000:3.0:1788687811.235654:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687811.235657:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.235663:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e7444990d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687811.235762:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11522:x1875574819729152:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 675us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687811.235771:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 172 00000100:00100000:1.0:1788687811.249161:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687811.249280:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819729408 00000100:00100000:3.0:1788687811.249296:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819729408 00000100:00100000:3.0:1788687811.249385:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 173 00000100:00100000:3.0:1788687811.249419:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11522:x1875574819729408:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687811.249448:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687811.249474:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449914 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462dea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.249687:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444991b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.249706:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444991b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.249721:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444991b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687811.249735:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788687811.250963:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444991b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.251001:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444991b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.251010:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444991b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.251017:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687811.251022:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444991b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.251032:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444991b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.251050:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ca00) 00010000:00010000:2.0:1788687811.251054:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687811.251061:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444991b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.251068:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e7444991b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.251142:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449914 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dea expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.251156:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:2.0:1788687811.251158:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788687811.251163:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449914 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dea expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.251174:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad400, rc 0) 00000100:00100000:2.0:1788687811.251332:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11522:x1875574819729408:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1916us (2187us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788687811.251343:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 173 00000100:00100000:1.0:1788687811.263791:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687811.264151:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819729536 00000100:00100000:3.0:1788687811.264165:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819729536 00000100:00100000:3.0:1788687811.264233:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 174 00000100:00100000:3.0:1788687811.264245:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11522:x1875574819729536:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788687811.264284:0:8462:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788687811.265468:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11522:x1875574819729536:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 1216us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687811.265495:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 174 00000100:00100000:1.0:1788687811.270277:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.270362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819729792 00000100:00100000:2.0:1788687811.270373:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819729792 00000100:00100000:2.0:1788687811.270444:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 175 00000100:00100000:2.0:1788687811.270454:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11522:x1875574819729792:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788687811.270475:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687811.270478:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788687811.270550:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e744498d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ddc expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.270572:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:2.0:1788687811.270578:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788687811.270593:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449929 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462df1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788687811.271322:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788687811.271633:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.271648:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.271659:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.271717:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449929 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df1 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.271747:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df1 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.271755:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29feb00) 00010000:00010000:2.0:1788687811.271758:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687811.271761:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3200, rc 0) 00000100:00100000:2.0:1788687811.271843:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11522:x1875574819729792:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1390us (1578us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788687811.271852:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 175 00000100:00100000:1.0:1788687811.283690:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687811.289034:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819730048 00000100:00100000:0.0:1788687811.289053:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819730048 00000100:00100000:1.0:1788687811.293117:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 176 00000100:00100000:1.0:1788687811.293134:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11522:x1875574819730048:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788687811.293210:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687811.293241:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df1 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.293282:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29feb00) 00010000:00010000:1.0:1788687811.293293:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687811.293317:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444993e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.293330:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444993e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.293341:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444993e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.293354:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449945 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9fabd5c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.293361:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449945 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9fabd5c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.293366:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449945 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9fabd5c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.293980:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444993e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.293990:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444993e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.293998:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444993e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294003:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687811.294008:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444993e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294022:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444993e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294033:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:1.0:1788687811.294036:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687811.294040:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444993e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294046:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444993e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294056:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449945 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9fabd5c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294061:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449945 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9fabd5c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294066:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449945 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9fabd5c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294071:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cda00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687811.294074:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449945 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9fabd5c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294079:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449945 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9fabd5c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294086:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9fabd5c6 (ffff9af3c7fb4f00) 00010000:00010000:1.0:1788687811.294088:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687811.294091:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449945 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9fabd5c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.294107:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449945 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9fabd5c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687811.294311:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11522:x1875574819730048:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 1178us (10628us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788687811.294320:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 176 00000100:00100000:1.0:1788687811.307743:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.307870:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819730176 00000100:00100000:2.0:1788687811.307881:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819730176 00000100:00100000:2.0:1788687811.307942:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 177 00000100:00100000:2.0:1788687811.307955:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11522:x1875574819730176:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788687811.308044:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687811.308071:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444994c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462df8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.308111:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.308125:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.308134:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.308241:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444994c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df8 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.308269:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df8 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.308278:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:2.0:1788687811.308281:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788687811.308284:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2400, rc 0) 00000100:00100000:2.0:1788687811.308357:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11522:x1875574819730176:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 405us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687811.308365:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 177 00000100:00100000:0.0:1788687811.318463:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.327890:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819730432 00000100:00100000:2.0:1788687811.327908:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819730432 00000100:00100000:2.0:1788687811.328018:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 178 00000100:00100000:2.0:1788687811.328032:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11522:x1875574819730432:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788687811.328132:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.328150:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.328163:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788687811.328512:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788687811.328522:0:8462:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357019040862ns, next at 358019038415ns, rc = 0 00000004:00010000:2.0:1788687811.328637:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cd6db81 reply state 0000000002727d6f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687811.328669:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788687811.328800:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:11522:x1875574819730432:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 770us (10348us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788687811.328808:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 178 00000100:00100000:0.0:1788687811.334131:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687811.334293:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819730560 00000100:00100000:1.0:1788687811.334304:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819730560 00000100:00100000:1.0:1788687811.334370:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 179 00000100:00100000:1.0:1788687811.334380:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:11522:x1875574819730560:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687811.334405:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687811.334427:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449961 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462dff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.334525:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449961 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dff expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.334539:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449961 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dff expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.334559:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:1.0:1788687811.334563:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687811.334566:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cda00, rc 0) 00000100:00100000:1.0:1788687811.334637:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:11522:x1875574819730560:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 258us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687811.334660:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 179 00010000:00010000:2.0:1788687811.335410:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.335422:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.335429:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.335435:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687811.335440:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.335448:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.335461:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:2.0:1788687811.335464:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788687811.335467:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.335473:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e7444995a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687811.343166:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687811.343285:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819730688 00000100:00100000:0.0:1788687811.343297:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819730688 00000100:00100000:0.0:1788687811.343382:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:0.0:1788687811.343395:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819730688:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788687811.344086:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819730688:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 680us (916us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788687811.344096:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:0.0:1788687811.346951:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.351460:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819730944 00000100:00100000:2.0:1788687811.351494:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819730944 00000100:00100000:3.0:1788687811.351673:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:3.0:1788687811.351683:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:11522:x1875574819730944:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788687811.351949:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:11522:x1875574819730944:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 266us (5008us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788687811.351964:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:0.0:1788687811.359407:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.359570:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819731200 00000100:00100000:2.0:1788687811.359580:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819731200 00000100:00100000:2.0:1788687811.359653:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 180 00000100:00100000:2.0:1788687811.359664:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:11522:x1875574819731200:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788687811.359784:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:11522:x1875574819731200:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 122us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687811.359791:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 180 00000100:00100000:3.0:1788687811.362327:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.362738:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819731328 00000100:00100000:2.0:1788687811.362750:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819731328 00000100:00100000:2.0:1788687811.362808:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 181 00000100:00100000:2.0:1788687811.362819:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:11522:x1875574819731328:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788687811.362838:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687811.362858:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e06 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.362931:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444996f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.362945:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444996f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.362955:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444996f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687811.363005:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687811.363024:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444996f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.363245:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e06 expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.363279:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444996f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e06 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.363288:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:2.0:1788687811.363291:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788687811.363294:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3e00, rc 0) 00000100:00100000:2.0:1788687811.363541:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11522:x1875574819731328:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 723us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687811.363549:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 181 00000100:00100000:0.0:1788687811.372031:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687811.372197:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819731456 00000100:00100000:1.0:1788687811.372218:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819731456 00000100:00100000:1.0:1788687811.372281:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:1.0:1788687811.372300:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819731456:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687811.372319:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687811.372343:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6cc823a/0xc2ddd83e74449976 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e0d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687811.372371:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d35c2, blocks: 0x1 00010000:00010000:1.0:1788687811.372391:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1788687811.372395:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687811.372404:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6cc823a/0xc2ddd83e74449976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e0d expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.372423:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6cc823a/0xc2ddd83e74449976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e0d expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.372435:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd400, rc 0) 00000100:00100000:1.0:1788687811.373141:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819731456:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 832us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687811.373151:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:0.0:1788687811.387587:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.387778:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819731712 00000100:00100000:2.0:1788687811.387789:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819731712 00000100:00100000:2.0:1788687811.387862:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 182 00000100:00100000:2.0:1788687811.387873:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11522:x1875574819731712:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788687811.388153:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11522:x1875574819731712:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 281us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687811.388160:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 182 00000100:00100000:2.0:1788687811.400552:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687811.400645:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819731840 00000100:00100000:0.0:1788687811.400656:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819731840 00000100:00100000:0.0:1788687811.400729:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:0.0:1788687811.400739:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:11522:x1875574819731840:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788687811.400758:0:8309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687811.400777:0:8309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e14 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.400830:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6cc823a/0xc2ddd83e74449976 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e0d expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.400841:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687811.400846:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687811.400852:0:8309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 9 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.400894:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6cc823a/0xc2ddd83e74449976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e0d expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.400909:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6cc823a/0xc2ddd83e74449976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e0d expref: 9 pid: 6686 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687811.400923:0:8309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee465c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8309:1875574839649408:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687811.401023:0:8309:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1780 going to sleep for 11 seconds 00000100:00100000:2.0:1788687811.403959:0:8309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee465c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8309:1875574839649408:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687811.404010:0:8309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 9 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.404032:0:8309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed200, rc 0) 00000100:00100000:2.0:1788687811.404109:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:11522:x1875574819731840:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 3362us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687811.404136:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:1.0:1788687811.406220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687811.406892:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819731968 00000100:00100000:3.0:1788687811.406902:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819731968 00010000:00010000:3.0:1788687811.406950:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6cc823a/0xc2ddd83e74449976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e0d expref: 9 pid: 6686 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687811.407002:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1788687811.407013:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2348:x1875574819731968:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687811.407028:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687811.407052:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6cc823a/0xc2ddd83e74449976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e0d expref: 9 pid: 6686 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.407067:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6cc823a/0xc2ddd83e74449976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e0d expref: 9 pid: 6686 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.407090:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6cc823a/0xc2ddd83e74449976 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e0d expref: 9 pid: 6686 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.407110:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687811.407114:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687811.407123:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 8 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.407133:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 8 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.407186:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 8 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687811.407202:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875574839649536:192.168.204.26@tcp:105: 00000100:00100000:3.0:1788687811.407298:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788687811.413317:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687811.413869:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875574839649536:192.168.204.26@tcp:105: 00010000:00010000:3.0:1788687811.413935:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687811.414013:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2348:x1875574819731968:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 7001us (7802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687811.414025:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:0.0:1788687811.414950:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819732096 00000100:00100000:0.0:1788687811.414960:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819732096 00002000:00100000:0.0:1788687811.415019:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9af3f3eae680 x1875574819732096/t0(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:712/0 lens 504/0 e 0 to 0 dl 1788687822 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788687811.415030:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3f3eae680 with x1875574819732096 ext(0->8) 00002000:00010000:0.0:1788687811.415036:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3f3eae680 00000100:00100000:0.0:1788687811.415059:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:0.0:1788687811.415069:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2346:x1875574819732096:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788687811.416524:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:2346:x1875574819732096:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 Request processed in 1441us (3203us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788687811.416537:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00002000:00100000:0.0:1788687811.417853:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9af3f3eae680 x1875574819732096/t4294967315(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:712/0 lens 504/448 e 0 to 0 dl 1788687822 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788687811.417866:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3f3eae680 with x1875574819732096 ext(0->8) 00002000:00010000:0.0:1788687811.417873:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3f3eae680 00000100:00100000:1.0:1788687811.424144:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687811.424242:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819732224 00000100:00100000:3.0:1788687811.424252:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819732224 00000100:00100000:3.0:1788687811.424314:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 183 00000100:00100000:3.0:1788687811.424324:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11522:x1875574819732224:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788687811.453444:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11522:x1875574819732224:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 29106us (29295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687811.453459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 183 00000001:00080000:1.0:1788687811.453917:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:1.0:1788687811.453929:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1788687811.453949:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1788687811.453954:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1788687811.453978:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:1.0:1788687811.454218:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839649664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788687811.454273:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788687811.454351:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788687811.454361:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788687811.454381:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839649664 00000100:00100000:3.0:1788687811.454389:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839649664 00000100:00080000:0.0:1788687811.454426:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788687811.454445:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788687811.454454:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839649664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788687811.454634:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788687811.454638:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788687810 00002000:00010000:3.0:1788687811.454640:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788687811.454655:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788687810 -> 1788687810 00002000:00010000:3.0:1788687811.454658:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:1.0:1788687811.455988:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3f3c52a00/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788687811.455997:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839649664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788687811.456035:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875574839649664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1322us (1502us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788687811.456047:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788687811.458638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687811.458884:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819732352 00000100:00100000:1.0:1788687811.458896:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819732352 00000100:00100000:1.0:1788687811.458958:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:1.0:1788687811.458970:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:2347:x1875574819732352:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788687811.507102:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1788687811.507141:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000100:00100000:3.0:1788687811.507366:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2347:x1875574819732352:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 48391us (48729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687811.507377:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:0.0:1788687811.511260:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687811.511427:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819732608 00000100:00100000:3.0:1788687811.511439:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819732608 00000100:00100000:3.0:1788687811.511581:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 184 00000100:00100000:3.0:1788687811.511592:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11522:x1875574819732608:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788687811.511663:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687811.511695:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e7444996f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e06 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.511716:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:3.0:1788687811.511721:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687811.511758:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.511771:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.511780:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788687811.512057:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053cf648d reply state 00000000ede2153d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687811.512084:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788687811.512539:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11522:x1875574819732608:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 947us (1288us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788687811.512558:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 184 00000100:00100000:1.0:1788687811.515607:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.515883:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819732736 00000100:00100000:2.0:1788687811.515893:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819732736 00000100:00100000:2.0:1788687811.515959:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:2.0:1788687811.515971:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2346:x1875574819732736:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788687811.516233:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788687811.516238:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788687810 -> 1788687809 00002000:00010000:2.0:1788687811.516240:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788687808 00002000:00010000:2.0:1788687811.516243:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788687810 -> 1788687809 00002000:00010000:2.0:1788687811.516246:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788687811.516306:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2346:x1875574819732736:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 337us (708us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788687811.516313:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00010000:00010000:3.0:1788687811.518981:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.518998:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.519005:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.519010:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687811.519015:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.519022:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.519040:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:3.0:1788687811.519043:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687811.519047:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.519053:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449984 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687811.519639:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.519740:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819732992 00000100:00100000:2.0:1788687811.519749:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819732992 00000100:00100000:2.0:1788687811.519802:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 185 00000100:00100000:2.0:1788687811.519813:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11522:x1875574819732992:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788687811.519885:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.519902:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df8 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.519911:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.519964:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df8 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.519978:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df8 expref: 18 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687811.519994:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c52300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839649792:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687811.520094:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c85703c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687811.523323:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.523514:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c52300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839649792:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687811.523544:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687811.523799:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819733120 00000100:00100000:1.0:1788687811.523808:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819733120 00010000:00010000:1.0:1788687811.523846:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df8 expref: 19 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687811.523886:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:1.0:1788687811.523895:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee465c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:2348:x1875574819733120:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687811.524096:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687811.524125:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df8 expref: 19 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.524138:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df8 expref: 19 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.524162:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462df8 expref: 19 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.524177:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:1.0:1788687811.524182:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.524191:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.524200:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.524228:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687811.524286:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee465c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:2348:x1875574819733120:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 391us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687811.524293:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00010000:00010000:2.0:1788687811.524839:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.524850:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.524885:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.524892:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.524899:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.524905:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3a00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687811.524910:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.524927:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.524939:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:2.0:1788687811.524942:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788687811.524947:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.524953:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3a00/0xc2ddd83e7444998b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687811.525015:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:11522:x1875574819732992:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 Request processed in 5203us (5379us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788687811.525024:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 185 00000100:00100000:0.0:1788687811.528223:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.528308:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819733248 00000100:00100000:2.0:1788687811.528318:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819733248 00000100:00100000:2.0:1788687811.528374:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:2.0:1788687811.528385:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2346:x1875574819733248:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788687811.528433:0:8309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.528454:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 8 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.528464:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687811.528468:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788687811.528472:0:8309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.528570:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 8 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.528585:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 8 pid: 8309 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687811.528600:0:8309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8309:1875574839649920:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687811.528688:0:8309:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c85703c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687811.532382:0:8309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8309:1875574839649920:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687811.532415:0:8309:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687811.536630:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687811.537075:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819733376 00000100:00100000:1.0:1788687811.537086:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819733376 00010000:00010000:1.0:1788687811.537145:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 9 pid: 8309 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687811.537190:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:1.0:1788687811.537200:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2348:x1875574819733376:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687811.537228:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687811.537255:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 9 pid: 8309 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.537269:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 9 pid: 8309 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.537294:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000afd80d3/0xc2ddd83e7444997d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e14 expref: 9 pid: 8309 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.537312:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788687811.537317:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788687811.537322:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.537331:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.537365:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687811.537581:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2348:x1875574819733376:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 382us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687811.537589:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00010000:00010000:0.0:1788687811.537829:0:8309:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.537841:0:8309:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.537879:0:8309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.537888:0:8309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.537897:0:8309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.537904:0:8309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687811.537909:0:8309:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.537918:0:8309:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.537932:0:8309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.537940:0:8309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063b51aa0/0xc2ddd83e74449992 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687811.537987:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2346:x1875574819733248:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 9604us (9774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687811.537995:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:1.0:1788687811.540819:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.540911:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819733632 00000100:00100000:2.0:1788687811.540921:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819733632 00000100:00100000:2.0:1788687811.541023:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 186 00000100:00100000:2.0:1788687811.541035:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+17:11522:x1875574819733632:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788687811.541132:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449999 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.541151:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.541163:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.541367:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.541380:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449961 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dff expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.541404:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.541435:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449961 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dff expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.541449:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449961 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dff expref: 18 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687811.541463:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c53480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839650048:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687811.541592:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8570000 going to sleep for 11 seconds 00000100:00100000:0.0:1788687811.544595:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687811.544683:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c53480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839650048:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687811.544711:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687811.544793:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819733760 00000100:00100000:3.0:1788687811.544800:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819733760 00010000:00010000:3.0:1788687811.544963:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449961 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dff expref: 19 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687811.545028:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:3.0:1788687811.545036:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:2349:x1875574819733760:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687811.545051:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687811.545058:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449961 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dff expref: 19 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.545070:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449961 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dff expref: 19 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.545093:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449961 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462dff expref: 19 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.545114:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:3.0:1788687811.545119:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.545128:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.545136:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687811.545163:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687811.545217:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:2349:x1875574819733760:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 180us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687811.545225:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00010000:00010000:2.0:1788687811.545225:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.545232:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788687811.545412:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788687811.545892:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788687811.545938:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788687811.546023:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c53480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1875574839650176:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788687811.546083:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687811.546115:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8570240 going to sleep for 11 seconds 00000100:00100000:0.0:1788687811.546144:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839650176 00000100:00100000:0.0:1788687811.546150:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839650176 00000100:00100000:0.0:1788687811.546187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788687811.546195:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8462:x1875574839650176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788687811.546266:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8462:x1875574839650176:12345-0@lo:1000:mdt00_003.0 Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687811.546273:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788687811.546297:0:8462:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788687811.546303:0:8462:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3f3c52a00, transno 4294967316 00000100:00100000:2.0:1788687811.546327:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c53480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1875574839650176:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788687811.547503:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788687811.547755:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c53480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1875574839650304:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788687811.547993:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687811.548031:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8570000 going to sleep for 11 seconds 00000100:00100000:0.0:1788687811.548053:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839650304 00000100:00100000:0.0:1788687811.548061:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839650304 00000100:00100000:0.0:1788687811.548152:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788687811.548163:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8462:x1875574839650304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788687811.548382:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8462:x1875574839650304:12345-0@lo:1000:mdt00_003.0 Request processed in 219us (387us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788687811.548389:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788687811.548460:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c53480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1875574839650304:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788687811.548531:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548541:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548549:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548555:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687811.548573:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548582:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548597:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:2.0:1788687811.548600:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788687811.548604:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548631:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548677:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548683:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548688:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548694:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687811.548697:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548703:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548712:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ca00) 00010000:00010000:2.0:1788687811.548715:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788687811.548718:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548724:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744498dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548744:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548758:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462de3 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548768:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548803:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462de3 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.548816:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462de3 expref: 21 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687811.548827:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c52300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839650432:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687811.548899:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8570000 going to sleep for 11 seconds 00000100:00100000:2.0:1788687811.551626:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c52300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839650432:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687811.551657:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687811.552522:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687811.552734:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819733888 00000100:00100000:0.0:1788687811.552743:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819733888 00010000:00010000:0.0:1788687811.552785:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462de3 expref: 22 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687811.552825:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:0.0:1788687811.552836:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:2348:x1875574819733888:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687811.552852:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687811.552859:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462de3 expref: 22 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.552872:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462de3 expref: 22 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.552921:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2e00/0xc2ddd83e744498f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462de3 expref: 22 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.552937:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ca00) 00010000:00010000:0.0:1788687811.552943:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.552953:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.552961:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687811.552989:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788687811.553011:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553019:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553030:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553037:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553044:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553050:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687811.553055:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553071:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553080:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ca00) 00010000:00010000:2.0:1788687811.553083:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687811.553087:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553092:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2600/0xc2ddd83e744499a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553103:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553108:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449999 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553114:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449999 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553118:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687811.553121:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449999 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553126:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449999 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553133:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ca00) 00010000:00010000:2.0:1788687811.553135:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788687811.553137:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449999 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.553152:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2800/0xc2ddd83e74449999 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687811.553505:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:2348:x1875574819733888:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 646us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687811.553514:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00000040:00080000:1.0:1788687811.553724:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687811.553728:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687811.554186:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000100:00100000:2.0:1788687811.554252:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11522:x1875574819733632:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 13219us (13440us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788687811.554261:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 186 00000020:00080000:2.0:1788687811.554266:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788687811.554786:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788687811.558381:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687811.558468:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819734144 00000100:00100000:3.0:1788687811.558587:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819734144 00000100:00100000:2.0:1788687811.558755:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:2.0:1788687811.558767:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11522:x1875574819734144:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788687811.559383:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788687811.559474:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788687811.559549:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.559578:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.559589:0:5842:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.559598:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.559605:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.559622:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687811.559646:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788687811.559751:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:11522:x1875574819734144:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 984us (1380us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788687811.559760:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00000020:00080000:2.0:1788687811.559764:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788687811.560184:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687811.560191:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.560199:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687811.560203:0:5828:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.560211:0:5828:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.560225:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9af3e29fe600) 00010000:00010000:1.0:1788687811.560227:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788687811.560231:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.560237:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e744499ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687811.560256:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687811.560257:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687811.560259:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687812.103127:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788687812.909393:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687812.909406:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687812.909457:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788687812.909465:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788687813.024537:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687813.024654:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819734400 00000100:00100000:0.0:1788687813.024667:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819734400 00000100:00100000:0.0:1788687813.024820:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 187 00000100:00080000:2.0:1788687813.024891:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687813.025033:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:11539:x1875574819734400:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687813.025069:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687813.025100:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744499b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e1b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.025253:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e744499bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.025292:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e744499bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.025312:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e744499bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687813.025330:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788687813.025558:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e744499b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e1b expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.025595:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e744499bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e1b expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.025607:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:0.0:1788687813.025610:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788687813.025615:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec200, rc 0) 00000100:00100000:0.0:1788687813.025702:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11539:x1875574819734400:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 684us (1186us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788687813.025710:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 187 00000100:00100000:3.0:1788687813.034525:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.034624:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819734528 00000100:00100000:1.0:1788687813.034637:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819734528 00000100:00100000:1.0:1788687813.034722:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 188 00000100:00100000:1.0:1788687813.034735:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11539:x1875574819734528:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:1.0:1788687813.034843:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744499ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.034865:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744499ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.034880:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744499ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.034896:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744499d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.034903:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744499d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.034910:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744499d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035227:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035236:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035243:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788687813.035301:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035316:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744499ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035333:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744499ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035341:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744499ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035347:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687813.035352:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744499ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035361:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744499ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035375:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:1.0:1788687813.035377:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687813.035381:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744499ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035388:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e744499ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035400:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744499d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035407:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744499d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035413:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744499d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035418:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687813.035424:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744499d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035431:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744499d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035437:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3c7fb4d00) 00010000:00010000:1.0:1788687813.035439:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687813.035442:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744499d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035447:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e744499d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035461:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035467:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035472:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.035476:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687813.036148:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.036160:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.036174:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3c7fb4500) 00010000:00010000:1.0:1788687813.036177:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687813.036191:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.036198:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e744499d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.036335:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11539:x1875574819734528:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 1597us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687813.036348:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 188 00000100:00100000:2.0:1788687813.073720:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687813.073875:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819734784 00000100:00100000:3.0:1788687813.073889:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819734784 00000100:00100000:3.0:1788687813.073970:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 189 00000100:00100000:3.0:1788687813.073982:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+24:11542:x1875574819734784:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687813.074012:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687813.074049:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744499df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e22 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074153:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744499e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074174:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744499e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074189:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744499e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074208:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744499ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074215:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744499ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074222:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744499ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074653:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074670:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074688:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687813.074702:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788687813.074834:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744499e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074844:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744499e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074853:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744499e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074860:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687813.074865:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744499e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074874:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744499e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074889:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:3.0:1788687813.074893:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687813.074899:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744499e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074905:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e744499e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074917:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744499ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074929:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744499ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074935:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744499ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074940:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687813.074944:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744499ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074964:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744499ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074974:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3ca87c000) 00010000:00010000:3.0:1788687813.074977:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687813.074979:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744499ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.074985:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e744499ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.075036:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e744499df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e22 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.075051:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e22 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.075060:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:3.0:1788687813.075063:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687813.075075:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aade00, rc 0) 00000100:00100000:3.0:1788687813.075161:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:11542:x1875574819734784:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1181us (1453us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788687813.075171:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 189 00000100:00100000:3.0:1788687813.079982:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687813.080268:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819734912 00000100:00100000:2.0:1788687813.080284:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819734912 00000100:00100000:2.0:1788687813.080530:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 190 00000100:00100000:2.0:1788687813.080546:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:11542:x1875574819734912:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:2.0:1788687813.080664:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449a02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.080688:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.080703:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.080742:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.080750:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449a02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.080759:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.080766:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687813.080787:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.080797:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449a02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.080813:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:2.0:1788687813.080817:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788687813.080824:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449a02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.080831:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3800/0xc2ddd83e74449a02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687813.080941:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:11542:x1875574819734912:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 399us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687813.080950:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 190 00000100:00100000:1.0:1788687813.086473:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687813.086647:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819735168 00000100:00100000:2.0:1788687813.086663:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819735168 00000100:00100000:2.0:1788687813.086756:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:2.0:1788687813.086771:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:11542:x1875574819735168:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788687813.087102:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:11542:x1875574819735168:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 334us (640us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788687813.087111:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00010000:00010000:2.0:1788687813.125757:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687813.132202:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687813.132465:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819735424 00000100:00100000:0.0:1788687813.132500:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819735424 00000100:00100000:0.0:1788687813.132605:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 191 00000100:00100000:0.0:1788687813.132618:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:11069:x1875574819735424:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788687813.132656:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687813.132687:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449a09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.132854:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.132873:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e22 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.132885:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.132929:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e22 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.132945:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e22 expref: 28 pid: 5840 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687813.132963:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba8bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839650560:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687813.133076:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788687813.139082:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba8bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839650560:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687813.139125:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687813.140384:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.140922:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819735552 00000100:00100000:1.0:1788687813.140935:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819735552 00010000:00010000:1.0:1788687813.140994:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e22 expref: 29 pid: 5840 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.141036:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:1.0:1788687813.141046:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:2348:x1875574819735552:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687813.141066:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687813.141074:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e22 expref: 29 pid: 5840 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.141089:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e22 expref: 29 pid: 5840 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.141128:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e744499f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e22 expref: 29 pid: 5840 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.141151:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:1.0:1788687813.141158:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.141186:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.141195:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.141243:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687813.141293:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.141306:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.141336:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:2348:x1875574819735552:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 289us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687813.141345:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 74 00000004:00200000:3.0:1788687813.141406:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788687813.141721:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449a09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e29 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.141789:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e29 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.141800:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:3.0:1788687813.141803:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788687813.141806:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed800, rc 0) 00000100:00100000:3.0:1788687813.141860:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:11069:x1875574819735424:12345-192.168.204.26@tcp:101:bash.0 Request processed in 9245us (9672us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788687813.141869:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 191 00000100:00100000:2.0:1788687813.143856:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.144082:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819735808 00000100:00100000:1.0:1788687813.144095:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819735808 00000100:00100000:1.0:1788687813.144163:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 192 00000100:00100000:1.0:1788687813.144175:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:11069:x1875574819735808:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:1.0:1788687813.145396:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.145423:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.145789:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788687813.145860:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788687813.145887:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d38403ee reply state 00000000036f3646 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.145896:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788687813.145942:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788687813.146192:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:11069:x1875574819735808:12345-192.168.204.26@tcp:36:bash.0 Request processed in 2016us (2345us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788687813.146219:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 192 00000020:00080000:1.0:1788687813.146226:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788687813.152677:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.152737:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819735936 00000100:00100000:1.0:1788687813.152751:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819735936 00000100:00100000:1.0:1788687813.152818:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 193 00000100:00100000:1.0:1788687813.152828:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:11069:x1875574819735936:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788687813.152862:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687813.152889:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449a25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e30 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.152902:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.152927:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.152934:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.152940:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687813.152945:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.152953:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.152969:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449a25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e30 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.156276:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:2.0:1788687813.156291:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687813.156304:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.156317:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449a1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.157055:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449a25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e30 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.157119:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:1.0:1788687813.157122:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687813.157125:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd000, rc 0) 00000100:00100000:1.0:1788687813.157574:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:11069:x1875574819735936:12345-192.168.204.26@tcp:101:bash.0 Request processed in 4744us (4911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687813.157594:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 193 00000100:00100000:3.0:1788687813.166042:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687813.166134:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819736064 00000100:00100000:2.0:1788687813.166147:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819736064 00000100:00100000:2.0:1788687813.166245:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:2.0:1788687813.166257:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:11069:x1875574819736064:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788687813.166281:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687813.166308:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d39dd3/0xc2ddd83e74449a2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e37 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788687813.166341:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9d35c1, atime: 0x6a9d35c0, ctime: 0x6a9d35c1, blocks: 0xb 00010000:00010000:2.0:1788687813.166388:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1788687813.166394:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687813.166405:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d39dd3/0xc2ddd83e74449a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e37 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.166428:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2d39dd3/0xc2ddd83e74449a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e37 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.166445:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3a00, rc 0) 00000100:00100000:2.0:1788687813.166551:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:11069:x1875574819736064:12345-192.168.204.26@tcp:101:bash.0 Request processed in 296us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687813.166558:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00080000:0.0:1788687813.166635:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687813.175110:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.175241:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819736192 00000100:00100000:1.0:1788687813.175255:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819736192 00002000:00010000:1.0:1788687813.175324:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788687813.175330:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3f3eafb80 with x1875574819736192 ext(0->18446744073709551615) 00002000:00010000:1.0:1788687813.175347:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3f3eafb80. 00000100:00100000:1.0:1788687813.175416:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:1.0:1788687813.175429:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819736192:12345-192.168.204.26@tcp:10:bash.0 00002000:00010000:3.0:1788687813.176693:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788687813.176703:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788687809 -> 1788687812 00002000:00010000:3.0:1788687813.176707:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788687808 -> 1788687808 00002000:00010000:3.0:1788687813.176709:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788687809 -> 1788687812 00002000:00010000:3.0:1788687813.176718:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788687813.176831:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2349:x1875574819736192:12345-192.168.204.26@tcp:10:bash.0 Request processed in 1400us (1732us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788687813.176849:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00002000:00010000:3.0:1788687813.176855:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788687813.176859:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3f3eafb80 with x1875574819736192 ext(0->18446744073709551615) 00002000:00010000:3.0:1788687813.176867:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3f3eafb80. 00000100:00100000:3.0:1788687813.275735:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687813.276046:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819736320 00000100:00100000:2.0:1788687813.276059:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819736320 00000100:00100000:2.0:1788687813.276125:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 194 00000100:00100000:2.0:1788687813.276136:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:11557:x1875574819736320:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:2.0:1788687813.276227:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276245:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276257:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276273:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276299:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276307:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276607:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276617:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276636:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788687813.276692:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276704:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276711:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276719:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276725:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687813.276729:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.276738:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277199:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:2.0:1788687813.277202:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687813.277207:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277214:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277230:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277237:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277243:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277249:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3e00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687813.277251:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277258:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277270:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3e29fea00) 00010000:00010000:2.0:1788687813.277273:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687813.277275:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277281:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277318:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277325:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277330:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277334:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687813.277337:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277343:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277351:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:2.0:1788687813.277353:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687813.277356:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.277360:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449a41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687813.277454:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:11557:x1875574819736320:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 1317us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687813.277464:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 194 00000100:00100000:1.0:1788687813.312219:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687813.312997:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819736576 00000100:00100000:3.0:1788687813.313011:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819736576 00000100:00100000:3.0:1788687813.313113:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 195 00000100:00100000:3.0:1788687813.313127:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+32:11560:x1875574819736576:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687813.313155:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687813.313183:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449a48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e3e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.313291:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449a4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.313317:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449a4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.313334:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449a4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.313353:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449a56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.313360:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.313391:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.314750:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449a5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.314770:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.314781:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687813.314793:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788687813.315767:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449a4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315781:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449a4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315788:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449a4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315794:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ec800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687813.315800:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449a4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315810:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449a4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315830:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:3.0:1788687813.315834:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687813.315860:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449a4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315868:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449a4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315889:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315895:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449a56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315902:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315907:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ec400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687813.315910:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315930:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449a56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315939:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3ca87c000) 00010000:00010000:3.0:1788687813.315942:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687813.315945:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449a56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.315951:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449a56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.316035:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449a48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e3e expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.316079:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449a5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e3e expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.316087:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:3.0:1788687813.316089:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788687813.316092:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ed800, rc 0) 00000100:00100000:3.0:1788687813.316205:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:11560:x1875574819736576:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 3078us (4002us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788687813.316217:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 195 00000100:00100000:3.0:1788687813.323903:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.325222:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819736704 00000100:00100000:1.0:1788687813.325240:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819736704 00000100:00100000:1.0:1788687813.325342:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 196 00000100:00100000:1.0:1788687813.325355:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:11560:x1875574819736704:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:1.0:1788687813.325454:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.325475:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e29 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.325536:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.325601:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e29 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.325619:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e29 expref: 34 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.325636:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839650688:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687813.325777:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8db3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687813.333447:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687813.333541:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819736960 00000100:00100000:2.0:1788687813.333551:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819736960 00000100:00100000:2.0:1788687813.333624:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:2.0:1788687813.333648:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+35:5583:x1875574819736960:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788687813.334018:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:5583:x1875574819736960:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 372us (580us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788687813.334027:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:1.0:1788687813.335184:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839650688:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687813.335213:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687813.342806:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687813.343019:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819737088 00000100:00100000:3.0:1788687813.343031:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819737088 00010000:00010000:3.0:1788687813.343083:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e29 expref: 36 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687813.343127:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:3.0:1788687813.343136:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c6908850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:2349:x1875574819737088:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687813.343151:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687813.343158:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e29 expref: 36 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.343171:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e29 expref: 36 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.343194:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e74449a10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e29 expref: 36 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.343227:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:3.0:1788687813.343233:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.343242:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.343249:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.343278:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687813.343439:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c6908850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+35:2349:x1875574819737088:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 303us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687813.343447:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 75 00010000:00010000:1.0:1788687813.343724:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.343733:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.343765:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.343772:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.343779:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.343794:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687813.343798:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.343806:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.343815:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:1.0:1788687813.343818:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788687813.343822:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.343827:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.343868:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:11560:x1875574819736704:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 18515us (19976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687813.343883:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 196 00000100:00100000:3.0:1788687813.356882:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687813.359317:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819737344 00000100:00100000:2.0:1788687813.359331:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819737344 00000100:00100000:2.0:1788687813.359396:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:2.0:1788687813.359407:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+34:11560:x1875574819737344:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788687813.362259:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+35:11560:x1875574819737344:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 2835us (5369us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788687813.362273:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:2.0:1788687813.531533:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.531643:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819737600 00000100:00100000:1.0:1788687813.531655:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819737600 00000100:00100000:1.0:1788687813.531724:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 197 00000100:00100000:1.0:1788687813.531735:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+35:11571:x1875574819737600:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:1.0:1788687813.531875:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687813.531900:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e45 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.531979:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449a79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.531994:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449a79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532005:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449a79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532019:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532027:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532033:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532309:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449a87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532331:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532339:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687813.532349:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788687813.532454:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449a79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532461:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449a79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532467:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449a79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532473:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687813.532478:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449a79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532518:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449a79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532530:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:1.0:1788687813.532533:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687813.532537:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449a79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532544:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449a79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532557:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532570:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449a80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532589:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532595:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cde00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687813.532598:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532605:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449a80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532614:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3c7fb4500) 00010000:00010000:1.0:1788687813.532617:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687813.532620:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449a80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532806:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449a80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532855:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449a72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e45 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532870:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449a87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e45 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.532878:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:1.0:1788687813.532880:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687813.532890:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd400, rc 0) 00000100:00100000:1.0:1788687813.533025:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+37:11571:x1875574819737600:12345-192.168.204.26@tcp:101:cat.0 Request processed in 1291us (1502us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788687813.533033:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 197 00000100:00100000:0.0:1788687813.554363:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.554519:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819737856 00000100:00100000:1.0:1788687813.554529:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819737856 00000100:00100000:1.0:1788687813.554602:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:1.0:1788687813.554612:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+37:11571:x1875574819737856:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:1.0:1788687813.554905:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:11571:x1875574819737856:12345-192.168.204.26@tcp:35:cat.0 Request processed in 291us (551us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788687813.554913:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:3.0:1788687813.582967:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687813.583086:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819738112 00000100:00100000:2.0:1788687813.583096:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819738112 00000100:00100000:2.0:1788687813.583154:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 198 00000100:00100000:2.0:1788687813.583164:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:11572:x1875574819738112:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:2.0:1788687813.583220:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788687813.583248:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449a87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e45 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583271:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449a5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e3e expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583282:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449a25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e30 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583312:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3ca87ce00) 00010000:00010000:2.0:1788687813.583323:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788687813.583345:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583357:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583366:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583379:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583386:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583393:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583692:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449aa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583701:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.583709:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788687813.584297:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788687813.584308:0:8462:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359274826565ns, next at 360274823967ns, rc = 0 00010000:00010000:2.0:1788687813.584369:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584379:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584387:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584394:0:8462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584401:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584408:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584433:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687813.584451:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584457:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449aa3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584464:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449aa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584470:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687813.584474:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449aa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584510:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449aa3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584525:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3e29fe700) 00010000:00010000:2.0:1788687813.584528:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788687813.584533:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449aa3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584540:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449aa3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584556:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584561:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584567:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584587:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3e00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687813.584591:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584597:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584604:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:2.0:1788687813.584607:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687813.584610:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.584616:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449a95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.584618:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:2.0:1788687813.584636:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000860d721f reply state 00000000d5a856f2 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.584639:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687813.584644:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788687813.584650:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687813.584653:0:5827:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.584658:0:5827:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.584666:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9af3e29fe700) 00010000:00010000:0.0:1788687813.584668:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788687813.584671:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.584675:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3200/0xc2ddd83e74449aaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.584687:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687813.584689:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687813.584691:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687813.584729:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+37:11572:x1875574819738112:12345-192.168.204.26@tcp:36:rm.0 Request processed in 1563us (1769us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788687813.584738:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 198 00010000:00010000:0.0:1788687813.589293:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.589312:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.589321:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.589327:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687813.589332:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.589365:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.589383:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3e29fea00) 00010000:00010000:0.0:1788687813.589386:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687813.589390:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.589397:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449a9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788687813.637991:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788687813.638757:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788687813.639362:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788687813.639370:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788687813.648002:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687813.648106:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819738368 00000100:00100000:0.0:1788687813.648117:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819738368 00000100:00100000:0.0:1788687813.648183:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 199 00000100:00100000:0.0:1788687813.648194:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+36:11578:x1875574819738368:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788687813.648219:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687813.648242:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449ab1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e4c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.648357:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449ab8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.648372:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.648383:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.648396:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.648417:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687813.648424:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788687813.649277:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788687813.649448:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649459:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649467:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649525:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649532:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449ab8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649539:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449ab8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649556:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687813.649561:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449ab8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649568:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449ab8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649591:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:1.0:1788687813.649595:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687813.649600:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449ab8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649606:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e74449ab8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788687813.649620:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a790e5b6 reply state 00000000307b5937 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.649639:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788687813.649670:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449ab1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e4c expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649684:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e4c expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.649690:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4500) 00010000:00010000:1.0:1788687813.649691:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687813.649693:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc200, rc 0) 00000100:00100000:1.0:1788687813.649824:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+39:11578:x1875574819738368:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1631us (1830us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788687813.649837:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 199 00000100:00100000:2.0:1788687813.655159:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:3.0:1788687813.655276:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.655289:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.655297:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.655303:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687813.655308:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.655334:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.655351:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3d2736900) 00010000:00010000:3.0:1788687813.655354:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687813.655358:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.655365:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449abf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.655530:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819738496 00000100:00100000:1.0:1788687813.655540:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819738496 00000100:00100000:1.0:1788687813.655634:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:1.0:1788687813.655649:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2347:x1875574819738496:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788687813.655669:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687813.655688:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1d8469c/0xc2ddd83e74449ad4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e53 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687813.655718:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687813.655749:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1788687813.655754:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687813.655764:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d8469c/0xc2ddd83e74449ad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e53 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.655783:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1d8469c/0xc2ddd83e74449ad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e53 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.655795:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cde00, rc 0) 00000100:00100000:1.0:1788687813.655853:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2347:x1875574819738496:12345-192.168.204.26@tcp:101:bash.0 Request processed in 206us (706us total) trans 0 rc 0/0 00000100:00080000:2.0:1788687813.655952:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788687813.659994:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:0.0:1788687813.660090:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687813.660126:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819738624 00000100:00100000:2.0:1788687813.660136:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819738624 00000100:00100000:2.0:1788687813.660189:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:2.0:1788687813.660199:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:11578:x1875574819738624:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788687813.660218:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687813.660237:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e5a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.660269:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1d8469c/0xc2ddd83e74449ad4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e53 expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.660278:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687813.660282:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687813.660287:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.660343:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1d8469c/0xc2ddd83e74449ad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e53 expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.660357:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1d8469c/0xc2ddd83e74449ad4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e53 expref: 9 pid: 6689 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687813.660370:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee466a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875574839650816:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687813.660954:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c95fd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687813.670101:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.670199:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819738752 00000100:00100000:1.0:1788687813.670209:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819738752 00010000:00010000:1.0:1788687813.670249:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d8469c/0xc2ddd83e74449ad4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e53 expref: 10 pid: 6689 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.670315:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:1.0:1788687813.670325:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c8835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:2349:x1875574819738752:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687813.670342:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687813.670365:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1d8469c/0xc2ddd83e74449ad4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e53 expref: 10 pid: 6689 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.670379:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1d8469c/0xc2ddd83e74449ad4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e53 expref: 10 pid: 6689 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.670404:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687813.670408:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687813.670417:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.670428:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.670462:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.670475:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1875574839650944:192.168.204.26@tcp:105: 00000100:00100000:1.0:1788687813.670915:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8db30c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788687813.671109:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1d8469c/0xc2ddd83e74449ad4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e53 expref: 10 pid: 6689 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687813.671128:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee466a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875574839650816:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687813.671153:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.671165:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3e00, rc 0) 00000100:00100000:2.0:1788687813.671193:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:11578:x1875574819738624:12345-192.168.204.26@tcp:101:bash.0 Request processed in 10996us (11104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687813.671201:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:2.0:1788687813.676037:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687813.676220:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819739008 00000100:00100000:0.0:1788687813.676229:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819739008 00000100:00100000:0.0:1788687813.676291:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:0.0:1788687813.676301:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+38:11578:x1875574819739008:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:0.0:1788687813.676692:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+39:11578:x1875574819739008:12345-192.168.204.26@tcp:35:bash.0 Request processed in 392us (665us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788687813.676699:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:1.0:1788687813.682049:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1875574839650944:192.168.204.26@tcp:105: 00010000:00010000:1.0:1788687813.682107:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687813.682175:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c8835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819738752:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 11850us (12084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687813.682186:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:3.0:1788687813.701962:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839651200:0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702049:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687813.702094:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839651712:0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702120:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687813.702146:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788687813.702152:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839651072:0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702178:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687813.702205:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee45df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839651584:0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702226:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687813.702251:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839651328:0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702273:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687813.702291:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788687813.702296:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c8837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839651456:0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702316:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687813.702364:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839651072 00000100:00100000:3.0:1788687813.702372:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839651072 00000100:00100000:3.0:1788687813.702413:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788687813.702421:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839651072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702470:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839651072:12345-0@lo:400:kworker.0 Request processed in 49us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687813.702477:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788687813.702552:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839651072:0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702594:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839651712 00000100:00100000:3.0:1788687813.702598:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839651712 00000100:00100000:3.0:1788687813.702630:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839651456 00000100:00100000:3.0:1788687813.702633:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839651456 00000100:00100000:3.0:1788687813.702654:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788687813.702660:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875574839651712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702696:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875574839651712:12345-0@lo:400:kworker.0 Request processed in 36us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687813.702702:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788687813.702713:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788687813.702718:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839651456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702747:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839651456:12345-0@lo:400:kworker.0 Request processed in 28us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687813.702753:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788687813.702778:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839651712:0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702799:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839651456:0@lo:400:kworker.0 00000100:00080000:3.0:1788687813.702812:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788687813.702816:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788687813.702842:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839651200 00000100:00100000:3.0:1788687813.702845:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839651200 00000100:00100000:3.0:1788687813.702868:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839651584 00000100:00100000:3.0:1788687813.702871:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839651584 00000100:00100000:3.0:1788687813.702886:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839651328 00000100:00100000:3.0:1788687813.702889:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839651328 00000100:00100000:3.0:1788687813.702903:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788687813.702909:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839651200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702943:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839651200:12345-0@lo:400:kworker.0 Request processed in 33us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687813.702948:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788687813.702959:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788687813.702964:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839651584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.702989:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839651584:12345-0@lo:400:kworker.0 Request processed in 25us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687813.702995:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788687813.703005:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788687813.703010:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839651328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.703037:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839651328:12345-0@lo:400:kworker.0 Request processed in 27us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687813.703043:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788687813.703066:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee45df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839651584:0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.703076:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839651200:0@lo:400:kworker.0 00000100:00100000:3.0:1788687813.703105:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c8835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839651328:0@lo:400:kworker.0 00000100:00080000:3.0:1788687813.703116:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687813.703513:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788687813.703528:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839651840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687813.703565:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687813.703719:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839651840 00000100:00100000:2.0:1788687813.703724:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839651840 00000100:00100000:2.0:1788687813.703764:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788687813.703772:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875574839651840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788687813.703807:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687813.703860:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875574839651840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687813.703866:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788687813.704400:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839651840:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788687813.784221:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1788687813.784246:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1788687813.847177:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687813.847519:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819739136 00000100:00100000:3.0:1788687813.847543:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819739136 00000100:00100000:3.0:1788687813.847633:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 200 00000100:00100000:3.0:1788687813.847644:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+39:11594:x1875574819739136:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687813.847671:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687813.847707:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449ae2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e61 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.847776:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449ae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.847791:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.847803:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687813.847844:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788687813.847848:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687813.847869:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.847897:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449ae2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e61 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.847920:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e61 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.847930:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:3.0:1788687813.847934:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788687813.847938:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ec400, rc 0) 00000100:00100000:3.0:1788687813.848007:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+40:11594:x1875574819739136:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 365us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687813.848015:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 200 00000100:00100000:0.0:1788687813.853310:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687813.853407:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819739392 00000100:00100000:3.0:1788687813.853418:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819739392 00000100:00100000:3.0:1788687813.853559:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 201 00000100:00100000:3.0:1788687813.853583:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+40:11594:x1875574819739392:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687813.853609:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687813.853644:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449af0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e68 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.853751:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449af7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.853766:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.853777:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687813.853789:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788687813.853927:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449af0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e68 expref: 43 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.853946:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e68 expref: 42 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.853956:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4500) 00010000:00010000:3.0:1788687813.853959:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687813.853975:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ec800, rc 0) 00000100:00100000:3.0:1788687813.854037:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+42:11594:x1875574819739392:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 468us (735us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788687813.854044:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 201 00000100:00100000:0.0:1788687813.859300:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687813.859359:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687813.859514:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819739776 00000100:00100000:3.0:1788687813.859528:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819739776 00000100:00100000:3.0:1788687813.859618:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 202 00000100:00100000:3.0:1788687813.859630:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+42:11594:x1875574819739776:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687813.859658:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687813.859680:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e6f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.859818:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.859834:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.859846:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687813.859858:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788687813.859994:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e6f expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.860016:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e6f expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.860026:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4500) 00010000:00010000:3.0:1788687813.860036:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788687813.860040:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ed800, rc 0) 00000100:00100000:3.0:1788687813.860103:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+44:11594:x1875574819739776:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 475us (743us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788687813.860110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 202 00000100:00100000:1.0:1788687813.860833:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819739520 00000100:00100000:1.0:1788687813.860841:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819739520 00000100:00100000:1.0:1788687813.860893:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:1.0:1788687813.860902:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+44:2346:x1875574819739520:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687813.860914:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687813.860932:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449af7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e68 expref: 44 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.860946:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4500) 00010000:00010000:1.0:1788687813.860950:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687813.860987:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+43:2346:x1875574819739520:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 86us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687813.861002:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:0.0:1788687813.869064:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687813.869241:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819739904 00000100:00100000:3.0:1788687813.869251:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819739904 00000100:00100000:3.0:1788687813.869314:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:3.0:1788687813.869325:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+6:2348:x1875574819739904:12345-192.168.204.26@tcp:1:lfs.0 00010000:00010000:3.0:1788687813.869370:0:8309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.869390:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.869399:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687813.869403:0:8309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687813.869408:0:8309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.869444:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.869459:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 6 pid: 6687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687813.869474:0:8309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8309:1875574839651968:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687813.869629:0:8309:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687813.872299:0:8309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8309:1875574839651968:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687813.872326:0:8309:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687813.873931:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.874946:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819740032 00000100:00100000:1.0:1788687813.874958:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819740032 00002000:00100000:1.0:1788687813.875022:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9af3c82e4e00 x1875574819740032/t0(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:714/0 lens 504/0 e 0 to 0 dl 1788687824 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788687813.875034:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c82e4e00 with x1875574819740032 ext(0->8) 00010000:00010000:1.0:1788687813.875043:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 7 pid: 6687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.875088:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 7 pid: 6687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687813.875097:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9af3c82e4e00 00000100:00100000:1.0:1788687813.875135:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:1.0:1788687813.875146:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819740032:12345-192.168.204.26@tcp:4:lfs.0 00000100:00100000:1.0:1788687813.875718:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2348:x1875574819740032:12345-192.168.204.26@tcp:4:lfs.0 Request processed in 572us (1792us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788687813.875726:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00002000:00100000:1.0:1788687813.875734:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9af3c82e4e00 x1875574819740032/t4294967308(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:714/0 lens 504/448 e 0 to 0 dl 1788687824 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788687813.875741:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c82e4e00 with x1875574819740032 ext(0->8) 00010000:00010000:1.0:1788687813.875748:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 9 pid: 6687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.875761:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 9 pid: 6687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687813.875768:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9af3c82e4e00 00000100:00100000:2.0:1788687813.879037:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687813.879207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819740160 00000100:00100000:3.0:1788687813.879220:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819740160 00010000:00010000:3.0:1788687813.879265:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 9 pid: 6687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687813.879303:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:3.0:1788687813.879313:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2347:x1875574819740160:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687813.879332:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788687813.879356:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788687813.879360:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788687813 00002000:00010000:3.0:1788687813.879363:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788687813 00002000:00010000:3.0:1788687813.879366:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788687813 00010000:00010000:3.0:1788687813.879371:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 9 pid: 6687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.879386:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 9 pid: 6687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.879412:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449adb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e5a expref: 9 pid: 6687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.879455:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687813.879460:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687813.879466:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.879478:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.879586:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687813.879642:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2347:x1875574819740160:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 330us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687813.879650:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00010000:00010000:2.0:1788687813.879785:0:8309:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.879794:0:8309:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.879818:0:8309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.879827:0:8309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.879835:0:8309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.879842:0:8309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ed200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687813.879847:0:8309:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.879855:0:8309:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.879874:0:8309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.879882:0:8309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f07642b0/0xc2ddd83e74449b1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687813.879930:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819739904:12345-192.168.204.26@tcp:1:lfs.0 Request processed in 10608us (10877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687813.879938:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1788687813.884212:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.884312:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819740416 00000100:00100000:1.0:1788687813.884324:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819740416 00000100:00100000:1.0:1788687813.884416:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:1.0:1788687813.884427:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+43:11594:x1875574819740416:12345-192.168.204.26@tcp:35:lfs.0 00000004:00010000:1.0:1788687813.884525:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e6f expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788687813.884796:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788687813.884842:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788687813.885164:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788687813.885212:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.885227:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e4c expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.885237:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.885271:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e4c expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.885286:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e4c expref: 47 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.885300:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1875574839652096:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687813.885385:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8db3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788687813.889253:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1875574839652096:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687813.889288:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687813.891131:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.891270:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819740544 00000100:00100000:1.0:1788687813.891293:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819740544 00010000:00010000:1.0:1788687813.891331:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e4c expref: 48 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687813.891369:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:1.0:1788687813.891379:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+48:2349:x1875574819740544:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687813.891392:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687813.891399:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e4c expref: 48 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.891411:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e4c expref: 48 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.891432:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e4c expref: 48 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.891450:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4500) 00010000:00010000:1.0:1788687813.891454:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.891463:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.891471:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.891539:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687813.891595:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+47:2349:x1875574819740544:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 216us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687813.891611:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00010000:00010000:2.0:1788687813.893409:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.893423:0:5843:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788687813.893596:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788687813.893798:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788687813.893919:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a43b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875574839652224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788687813.893979:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687813.894023:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788687813.894372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839652224 00000100:00100000:1.0:1788687813.894382:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839652224 00000100:00100000:1.0:1788687813.894439:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788687813.894450:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875574839652224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788687813.894551:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875574839652224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687813.894558:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788687813.894800:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1788687813.894806:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1788687813.894827:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3f3415c00, transno 4294967307 00000100:00100000:2.0:1788687813.894896:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a43b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875574839652224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788687813.895414:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788687813.895477:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a43b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875574839652352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788687813.895543:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687813.895594:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788687813.895625:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839652352 00000100:00100000:1.0:1788687813.895632:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839652352 00000100:00100000:1.0:1788687813.895668:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788687813.895676:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875574839652352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788687813.895823:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875574839652352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 147us (280us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788687813.895831:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788687813.895955:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a43b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875574839652352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788687813.896012:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788687813.896045:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.896056:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.896071:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.896078:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687813.896082:0:5843:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.896089:0:5843:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.896112:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4500) 00010000:00010000:2.0:1788687813.896116:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788687813.896120:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687813.896126:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449b21 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788687813.896288:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788687813.896889:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788687813.896900:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359587418554ns, next at 360587416425ns, rc = 0 00000001:00080000:2.0:1788687813.896920:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788687813.896956:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4500) 00010000:00010000:2.0:1788687813.896960:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788687813.896968:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e6f expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687813.897080:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+50:11594:x1875574819740416:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 12655us (12880us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788687813.897089:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00000020:00080000:2.0:1788687813.897093:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788687813.904562:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687813.908298:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819740672 00000100:00100000:1.0:1788687813.908310:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819740672 00000100:00100000:1.0:1788687813.908437:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 203 00000100:00100000:1.0:1788687813.908449:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+50:11594:x1875574819740672:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687813.908476:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687813.908519:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449b28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.908600:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449b28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e76 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.908742:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449b28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e76 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687813.908763:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687813.908766:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687813.908833:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc200, rc 0) 00000100:00100000:1.0:1788687813.908940:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:11594:x1875574819740672:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 493us (4389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687813.908947:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 203 00000100:00100000:0.0:1788687813.913510:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687813.917686:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819740928 00000100:00100000:2.0:1788687813.917701:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819740928 00000100:00100000:1.0:1788687813.917880:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:1.0:1788687813.917893:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+51:11594:x1875574819740928:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788687813.918149:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:11594:x1875574819740928:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 258us (4678us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788687813.918156:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:0.0:1788687813.992622:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687813.992950:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819741056 00000100:00100000:3.0:1788687813.992961:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819741056 00000100:00100000:3.0:1788687813.993115:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 204 00000100:00100000:3.0:1788687813.993127:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:11604:x1875574819741056:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:3.0:1788687813.993216:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b2f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.993236:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.993251:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.993269:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.993299:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.993306:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.993420:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.993429:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.993436:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788687813.994015:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994035:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994042:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b2f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994049:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994055:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ed000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687813.994060:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994067:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b2f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994434:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:3.0:1788687813.994438:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687813.994443:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994451:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994467:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994474:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994536:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994543:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ed800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687813.994547:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994554:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994573:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3ca87c000) 00010000:00010000:3.0:1788687813.994576:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687813.994580:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994587:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994617:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994624:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994631:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994636:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ed200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687813.994639:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994646:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994655:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:3.0:1788687813.994658:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687813.994661:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687813.994667:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687813.994762:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:11604:x1875574819741056:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 1635us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687813.994771:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 204 00000100:00100000:0.0:1788687814.046336:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.046522:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819741312 00000100:00100000:3.0:1788687814.046540:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819741312 00000100:00100000:1.0:1788687814.046961:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 205 00000100:00100000:1.0:1788687814.046977:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+52:11607:x1875574819741312:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687814.047014:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687814.047042:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449b44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e7d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.047205:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449b4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.047226:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449b4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.047266:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449b4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.047285:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.047292:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.047298:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.047888:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.047899:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.047907:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687814.047917:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788687814.048177:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449b4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048186:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449b4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048194:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449b4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048200:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687814.048214:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449b4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048223:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449b4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048236:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:1.0:1788687814.048240:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687814.048244:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449b4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048252:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449b4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048269:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048276:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048281:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048286:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687814.048289:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048295:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048303:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687814.048305:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687814.048314:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048320:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048373:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449b44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e7d expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.048389:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e7d expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.051270:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687814.051275:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687814.051279:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cda00, rc 0) 00000100:00100000:1.0:1788687814.052243:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:11607:x1875574819741312:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 5259us (5908us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788687814.052257:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 205 00000100:00100000:0.0:1788687814.072835:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687814.073671:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819741440 00000100:00100000:2.0:1788687814.073685:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819741440 00000100:00100000:2.0:1788687814.074333:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 206 00000100:00100000:2.0:1788687814.074351:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:11607:x1875574819741440:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:2.0:1788687814.074446:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449b67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.074469:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.074511:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.074547:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.074555:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449b67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.074598:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.074605:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687814.074611:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.074621:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449b67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.074636:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:2.0:1788687814.074639:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788687814.074644:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449b67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.074651:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2400/0xc2ddd83e74449b67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687814.074762:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:11607:x1875574819741440:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 416us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687814.074770:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 206 00000100:00100000:2.0:1788687814.079742:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.079864:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819741696 00000100:00100000:1.0:1788687814.079881:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819741696 00000100:00100000:1.0:1788687814.080049:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:1.0:1788687814.080063:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+54:11607:x1875574819741696:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788687814.080404:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:11607:x1875574819741696:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 342us (674us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788687814.080413:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00010000:00010000:2.0:1788687814.149917:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687814.174958:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687814.177240:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819741952 00000100:00100000:2.0:1788687814.177258:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819741952 00000100:00100000:3.0:1788687814.177627:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 207 00000100:00100000:3.0:1788687814.177662:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:11617:x1875574819741952:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788687814.177696:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687814.177699:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788687814.177747:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449ae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e61 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.177773:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:3.0:1788687814.177779:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687814.177797:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e84 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.177938:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.177954:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e7d expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.177964:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.178005:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e7d expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.178021:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e7d expref: 55 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.178036:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839652480:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687814.178168:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687814.184200:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839652480:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687814.184233:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687814.185948:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.186184:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819742080 00000100:00100000:3.0:1788687814.186195:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819742080 00010000:00010000:3.0:1788687814.186248:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e7d expref: 56 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.186300:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:3.0:1788687814.186322:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+56:2348:x1875574819742080:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687814.186340:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687814.186347:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e7d expref: 56 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.186362:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e7d expref: 56 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.186389:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449b59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e7d expref: 56 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.186412:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:3.0:1788687814.186418:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.186430:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.186439:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.186537:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687814.186629:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:2348:x1875574819742080:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 309us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687814.186637:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 79 00010000:00010000:2.0:1788687814.186888:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.186899:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687814.186938:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788687814.187155:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449b6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e84 expref: 56 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.187176:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e84 expref: 55 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.187185:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:2.0:1788687814.187187:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788687814.187189:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ed800, rc 0) 00000100:00100000:2.0:1788687814.187233:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:11617:x1875574819741952:12345-192.168.204.26@tcp:101:bash.0 Request processed in 9577us (12293us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788687814.187242:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 207 00000100:00100000:0.0:1788687814.192423:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.192724:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819742336 00000100:00100000:3.0:1788687814.192739:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819742336 00000100:00100000:3.0:1788687814.192817:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 208 00000100:00100000:3.0:1788687814.192829:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+55:11617:x1875574819742336:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:3.0:1788687814.193210:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.193231:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.193245:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788687814.193300:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788687814.193325:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abe5389a reply state 000000001e23402c transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.193334:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788687814.193527:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+58:11617:x1875574819742336:12345-192.168.204.26@tcp:36:bash.0 Request processed in 699us (1117us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788687814.193536:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 208 00000020:00080000:3.0:1788687814.193543:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788687814.199006:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.199453:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819742464 00000100:00100000:1.0:1788687814.199467:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819742464 00000100:00100000:3.0:1788687814.199707:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 209 00000100:00100000:3.0:1788687814.199721:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+58:11617:x1875574819742464:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788687814.199776:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687814.199801:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449b8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e8b expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.199917:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.199935:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e84 expref: 59 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.199944:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.199952:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.199974:0:8462:0:(ldlm_request.c:384:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.200017:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e84 expref: 59 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.200034:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e84 expref: 59 pid: 8462 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.200050:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839652608:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687814.200304:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2fb40 going to sleep for 11 seconds 00010000:00010000:0.0:1788687814.205601:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687814.205627:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687814.205636:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687814.205643:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ed000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687814.205649:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687814.205659:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687814.205683:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:0.0:1788687814.205687:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687814.205691:0:3296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687814.205705:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687814.205713:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449b83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687814.210130:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.210231:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819742592 00000100:00100000:1.0:1788687814.210243:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819742592 00010000:00010000:1.0:1788687814.210312:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e84 expref: 59 pid: 8462 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687814.210369:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:1.0:1788687814.210381:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:2349:x1875574819742592:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687814.210399:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687814.210406:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e84 expref: 59 pid: 8462 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.210420:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e84 expref: 59 pid: 8462 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.210447:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687814.210453:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.210464:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.210473:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.210522:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687814.210617:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:2349:x1875574819742592:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 238us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.210624:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 80 00010000:00010000:3.0:1788687814.211321:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449b75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e84 expref: 58 pid: 8462 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.211368:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1875574839652608:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687814.211395:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.211405:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.211412:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687814.211471:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788687814.211476:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687814.212050:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.212167:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449b8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e8b expref: 58 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.212187:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e8b expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.212196:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:3.0:1788687814.212198:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687814.212202:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ec800, rc 0) 00000100:00100000:3.0:1788687814.212325:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+57:11617:x1875574819742464:12345-192.168.204.26@tcp:101:bash.0 Request processed in 12608us (13335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687814.212334:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 209 00000100:00100000:0.0:1788687814.217432:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687814.217604:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819742848 00000100:00100000:2.0:1788687814.217618:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819742848 00000100:00100000:2.0:1788687814.217693:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:2.0:1788687814.217706:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+57:11617:x1875574819742848:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:2.0:1788687814.219104:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+58:11617:x1875574819742848:12345-192.168.204.26@tcp:35:bash.0 Request processed in 1391us (1679us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788687814.219120:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:1.0:1788687814.219591:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c315d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839652736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687814.219679:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687814.219811:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839652736 00000100:00100000:0.0:1788687814.219819:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839652736 00000100:00100000:0.0:1788687814.219872:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788687814.219881:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875574839652736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788687814.219925:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687814.219975:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875574839652736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687814.219981:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788687814.220028:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c315d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839652736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687814.368573:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.368675:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819742976 00000100:00100000:1.0:1788687814.368684:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819742976 00000100:00100000:1.0:1788687814.368779:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 210 00000100:00100000:1.0:1788687814.368789:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+58:11623:x1875574819742976:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687814.368811:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687814.368832:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449b98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.368944:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.368960:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.368977:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687814.369017:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788687814.369065:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687814.369087:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.369113:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449b98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e92 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.369131:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e92 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.369139:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:1.0:1788687814.369142:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788687814.369155:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cce00, rc 0) 00000100:00100000:1.0:1788687814.369213:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:11623:x1875574819742976:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 426us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.369221:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 210 00000100:00100000:2.0:1788687814.373669:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.373718:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819743104 00000100:00100000:1.0:1788687814.373728:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819743104 00000100:00100000:1.0:1788687814.373782:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 211 00000100:00100000:1.0:1788687814.373793:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:11623:x1875574819743104:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687814.373815:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687814.373836:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449ba6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462e99 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.373902:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449bad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.373917:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449bad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.373927:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449bad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.373943:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.373951:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.373958:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374081:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374105:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374113:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687814.374156:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788687814.374160:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687814.374180:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374192:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374200:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449bad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374207:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449bad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374214:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449bad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374220:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cda00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687814.374225:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449bad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374232:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449bad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374243:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:1.0:1788687814.374246:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687814.374258:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449bad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374264:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449bad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374278:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374284:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374290:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374295:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687814.374298:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374304:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374312:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687814.374315:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687814.374317:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374323:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374359:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449ba6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e99 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374387:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e99 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.374395:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687814.374398:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687814.374400:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cde00, rc 0) 00000100:00100000:1.0:1788687814.374548:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:11623:x1875574819743104:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 755us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.374573:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 211 00000100:00100000:0.0:1788687814.387893:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.387979:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819743232 00000100:00100000:3.0:1788687814.388002:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819743232 00000100:00100000:3.0:1788687814.388099:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788687814.388111:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c690a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:2348:x1875574819743232:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687814.388133:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687814.388165:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cde00/0xc2ddd83e74449bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e99 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.388191:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:3.0:1788687814.388199:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687814.388274:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c690a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:2348:x1875574819743232:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 165us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687814.388282:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:2.0:1788687814.394527:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.400591:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819743488 00000100:00100000:3.0:1788687814.400614:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819743488 00000100:00100000:3.0:1788687814.400724:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 212 00000100:00100000:3.0:1788687814.400737:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:11623:x1875574819743488:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687814.400764:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687814.400795:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449bc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ea0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.401015:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.401034:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e8b expref: 60 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.401046:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.401119:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e8b expref: 60 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.401135:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e8b expref: 60 pid: 8462 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.401152:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839652864:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687814.401462:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788687814.407714:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839652864:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687814.407760:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687814.411077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.412378:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819743616 00000100:00100000:1.0:1788687814.412396:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819743616 00010000:00010000:1.0:1788687814.412461:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e8b expref: 61 pid: 8462 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687814.412554:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:1.0:1788687814.412575:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:2348:x1875574819743616:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687814.412594:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687814.412602:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e8b expref: 61 pid: 8462 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.412618:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e8b expref: 61 pid: 8462 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.412648:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e8b expref: 61 pid: 8462 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.412692:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687814.412698:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.412709:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.412722:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.412759:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687814.412804:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.412812:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687814.412842:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:2348:x1875574819743616:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 269us (1796us total) trans 0 rc 0/0 00000004:00200000:3.0:1788687814.412847:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:1.0:1788687814.412850:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 81 00010000:00010000:3.0:1788687814.413158:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449bc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea0 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.413175:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea0 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.413184:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:3.0:1788687814.413187:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788687814.413200:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ed800, rc 0) 00000100:00100000:3.0:1788687814.413251:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:11623:x1875574819743488:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 12517us (18770us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788687814.413259:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 212 00000100:00100000:2.0:1788687814.416725:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.416821:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819743872 00000100:00100000:3.0:1788687814.416834:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819743872 00000100:00100000:3.0:1788687814.416907:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:3.0:1788687814.416919:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:11623:x1875574819743872:12345-192.168.204.26@tcp:103:lfs.0 00010000:00010000:3.0:1788687814.416939:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687814.416971:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449b28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e76 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.417006:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:3.0:1788687814.417012:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687814.417222:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:11623:x1875574819743872:12345-192.168.204.26@tcp:103:lfs.0 Request processed in 304us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687814.417231:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:2.0:1788687814.419983:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.420195:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819744000 00000100:00100000:1.0:1788687814.420207:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819744000 00000100:00100000:1.0:1788687814.420289:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 213 00000100:00100000:1.0:1788687814.420302:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:11623:x1875574819744000:12345-192.168.204.26@tcp:58:lfs.0 00010000:00010000:1.0:1788687814.420441:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.420463:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.420477:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788687814.420928:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788687814.421088:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:11623:x1875574819744000:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 786us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.421115:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 213 00000100:00100000:2.0:1788687814.423687:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.425212:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819744128 00000100:00100000:1.0:1788687814.425230:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819744128 00000100:00100000:1.0:1788687814.426289:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 214 00000100:00100000:1.0:1788687814.426306:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+59:11623:x1875574819744128:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687814.426343:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687814.426372:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ea7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.426451:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.426463:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bde lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea7 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.426513:0:5841:0:(ldlm_request.c:384:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.426532:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bde lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea7 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.426550:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687814.426566:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687814.426572:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bde lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea7 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.426580:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc400, rc 0) 00000100:00100000:1.0:1788687814.426692:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:11623:x1875574819744128:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 391us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.426699:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 214 00000040:00080000:2.0:1788687814.663351:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788687814.663362:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788687814.663420:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788687814.663427:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788687814.663757:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f7a40380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839652992:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788687814.663935:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788687814.666660:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f7a40380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839652992:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788687814.669522:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.669749:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819744256 00000100:00100000:3.0:1788687814.669760:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819744256 00000100:00100000:3.0:1788687814.669824:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 215 00000100:00100000:3.0:1788687814.669836:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:11624:x1875574819744256:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788687814.669866:0:8462:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788687814.669981:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:11624:x1875574819744256:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 147us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687814.669988:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 215 00000100:00100000:2.0:1788687814.673413:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.673514:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819744384 00000100:00100000:3.0:1788687814.673525:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819744384 00000100:00100000:3.0:1788687814.673615:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 216 00000100:00100000:3.0:1788687814.673626:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:11624:x1875574819744384:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788687814.673708:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449be5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673727:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449be5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673739:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449be5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673757:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449bec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673764:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449bec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673770:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449bec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673794:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673803:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673810:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687814.673848:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788687814.673852:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687814.673867:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673885:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449be5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673892:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449be5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673899:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449be5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673905:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ec400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687814.673909:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449be5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673916:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449be5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673928:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:3.0:1788687814.673931:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687814.673935:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449be5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673942:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec400/0xc2ddd83e74449be5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673956:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449bec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673963:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449bec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673968:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449bec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673981:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ec800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687814.673984:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449bec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673990:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449bec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.673999:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9af3ca87c000) 00010000:00010000:3.0:1788687814.674001:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687814.674004:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449bec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.674009:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ec800/0xc2ddd83e74449bec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.674023:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.674029:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.674034:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.674039:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ed000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687814.674042:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.674048:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.674067:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:3.0:1788687814.674069:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687814.674072:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.674078:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed000/0xc2ddd83e74449bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.674155:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:11624:x1875574819744384:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 531us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687814.674162:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 216 00000100:00100000:0.0:1788687814.676797:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.676879:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819744640 00000100:00100000:3.0:1788687814.676890:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819744640 00000100:00100000:3.0:1788687814.676949:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 217 00000100:00100000:3.0:1788687814.676959:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+60:11624:x1875574819744640:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687814.676979:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687814.676998:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449bfa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462eae expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677102:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677115:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677126:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687814.677136:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788687814.677253:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677261:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677268:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677275:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687814.677279:0:8462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677288:0:8462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677300:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:3.0:1788687814.677303:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788687814.677308:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677315:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677358:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449bfa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eae expref: 62 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677368:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:3.0:1788687814.677370:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788687814.677374:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed200/0xc2ddd83e74449bfa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eae expref: 62 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.677397:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3c13ed200, rc 0) 00000100:00100000:3.0:1788687814.677463:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:11624:x1875574819744640:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 505us (675us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788687814.677472:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 217 00000100:00100000:2.0:1788687814.680986:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.681076:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819744768 00000100:00100000:3.0:1788687814.681086:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819744768 00000100:00100000:3.0:1788687814.681147:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 218 00000100:00100000:3.0:1788687814.681159:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:11624:x1875574819744768:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788687814.681216:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788687814.681337:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:11624:x1875574819744768:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 180us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687814.681345:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 218 00000100:00100000:2.0:1788687814.690830:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.691203:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819745024 00000100:00100000:3.0:1788687814.691213:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819745024 00000100:00100000:3.0:1788687814.691276:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 219 00000100:00100000:3.0:1788687814.691287:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:11624:x1875574819745024:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687814.691307:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687814.691310:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788687814.691336:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449b9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e92 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.691355:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:3.0:1788687814.691360:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687814.691372:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462eb5 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788687814.691861:0:8462:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1788687814.692634:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.692652:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.692664:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.692723:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eb5 expref: 63 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.692741:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eb5 expref: 62 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.692750:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:3.0:1788687814.692753:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687814.692755:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac800, rc 0) 00000100:00100000:3.0:1788687814.692826:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+62:11624:x1875574819745024:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1541us (2006us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788687814.692834:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 219 00000100:00100000:0.0:1788687814.702072:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.702166:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819745280 00000100:00100000:3.0:1788687814.702178:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819745280 00000100:00100000:3.0:1788687814.702240:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 220 00000100:00100000:3.0:1788687814.702250:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+62:11624:x1875574819745280:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788687814.702310:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687814.702353:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eb5 expref: 62 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702374:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3ca87c000) 00010000:00010000:3.0:1788687814.702386:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687814.702408:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702423:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702432:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702542:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa850293a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702563:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa850293a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702571:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa850293a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702637:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702646:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c24 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702652:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702658:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687814.702669:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702677:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702687:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:3.0:1788687814.702690:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687814.702694:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702700:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aade00/0xc2ddd83e74449c24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702711:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa850293a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702717:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa850293a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702723:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa850293a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702728:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687814.702730:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa850293a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702736:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa850293a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702744:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa850293a (ffff9af3ca87c700) 00010000:00010000:3.0:1788687814.702746:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687814.702756:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa850293a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.702761:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa850293a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.702842:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:11624:x1875574819745280:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 593us (791us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788687814.702851:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 220 00000100:00100000:2.0:1788687814.709291:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.709611:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819745408 00000100:00100000:1.0:1788687814.709625:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819745408 00000100:00100000:1.0:1788687814.709691:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 221 00000100:00100000:1.0:1788687814.709703:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+61:11624:x1875574819745408:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687814.709725:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687814.709762:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ebc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.709800:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.709814:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.709825:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.709925:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ebc expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.709943:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ebc expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.709951:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687814.709963:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788687814.709967:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc000, rc 0) 00000100:00100000:1.0:1788687814.710035:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+62:11624:x1875574819745408:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 334us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.710042:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 221 00000100:00100000:0.0:1788687814.714644:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.715194:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819745664 00000100:00100000:1.0:1788687814.715204:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819745664 00000100:00100000:1.0:1788687814.715274:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 222 00000100:00100000:1.0:1788687814.715285:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+62:11624:x1875574819745664:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788687814.715381:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.715398:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.715410:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788687814.715697:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788687814.715706:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360406225014ns, next at 361406223224ns, rc = 0 00000004:00010000:1.0:1788687814.715799:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076af70d2 reply state 00000000a9264178 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687814.715808:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788687814.715903:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+64:11624:x1875574819745664:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 619us (1281us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788687814.715910:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 222 00010000:00010000:3.0:1788687814.718101:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.718117:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.718124:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.718130:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cda00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687814.718143:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.718152:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.718167:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687814.718170:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788687814.718174:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.718179:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687814.718334:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.718709:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819745792 00000100:00100000:3.0:1788687814.718718:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819745792 00000100:00100000:3.0:1788687814.718769:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 223 00000100:00100000:3.0:1788687814.718779:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+63:11624:x1875574819745792:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687814.718802:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687814.718821:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ec3 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.718877:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ec3 expref: 64 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.718890:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ec3 expref: 64 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.718910:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687814.718913:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788687814.718915:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad400, rc 0) 00000100:00100000:3.0:1788687814.719258:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+64:11624:x1875574819745792:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 479us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687814.719266:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 223 00000100:00100000:0.0:1788687814.728504:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.728655:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819745920 00000100:00100000:3.0:1788687814.728667:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819745920 00000100:00100000:3.0:1788687814.728733:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:3.0:1788687814.728745:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2348:x1875574819745920:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788687814.729173:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:2348:x1875574819745920:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 429us (703us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788687814.729195:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:2.0:1788687814.736605:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687814.737204:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819746176 00000100:00100000:0.0:1788687814.737214:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819746176 00000100:00100000:0.0:1788687814.737277:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:0.0:1788687814.737288:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+64:11624:x1875574819746176:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788687814.737719:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+65:11624:x1875574819746176:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 431us (1121us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788687814.737726:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:0.0:1788687814.747863:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.747966:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819746432 00000100:00100000:1.0:1788687814.747977:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819746432 00000100:00100000:1.0:1788687814.748256:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 224 00000100:00100000:1.0:1788687814.748267:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+65:11624:x1875574819746432:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788687814.748584:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+65:11624:x1875574819746432:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 317us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.748593:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 224 00000100:00100000:2.0:1788687814.753952:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.754137:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819746560 00000100:00100000:1.0:1788687814.754149:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819746560 00000100:00100000:1.0:1788687814.754336:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 225 00000100:00100000:1.0:1788687814.754349:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+65:11624:x1875574819746560:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687814.754381:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687814.754403:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449c4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462eca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.754478:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.754529:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.754542:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687814.754599:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687814.754619:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.754648:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449c4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eca expref: 67 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.754696:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eca expref: 66 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.754705:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687814.754708:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788687814.754711:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd400, rc 0) 00000100:00100000:1.0:1788687814.754921:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+66:11624:x1875574819746560:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 574us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.754928:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 225 00000100:00100000:2.0:1788687814.765722:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.765819:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819746688 00000100:00100000:1.0:1788687814.765831:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819746688 00000100:00100000:1.0:1788687814.765892:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:1.0:1788687814.765903:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+10:2349:x1875574819746688:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687814.765923:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687814.765945:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ed1 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687814.765976:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d35c6, blocks: 0x1 00010000:00010000:1.0:1788687814.766007:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1788687814.766012:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687814.766023:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed1 expref: 11 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.766054:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed1 expref: 11 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.766101:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd000, rc 0) 00000100:00100000:1.0:1788687814.766181:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:2349:x1875574819746688:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 279us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.766188:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1788687814.776118:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.776528:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819746944 00000100:00100000:3.0:1788687814.776539:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819746944 00000100:00100000:3.0:1788687814.776607:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 226 00000100:00100000:3.0:1788687814.776616:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+66:11624:x1875574819746944:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788687814.776728:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+66:11624:x1875574819746944:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 113us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687814.776735:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 226 00000100:00100000:0.0:1788687814.787318:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687814.787436:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819747072 00000100:00100000:2.0:1788687814.787447:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819747072 00000100:00100000:2.0:1788687814.787544:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:2.0:1788687814.787570:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+11:11624:x1875574819747072:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788687814.787590:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687814.787609:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ed8 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.787646:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed1 expref: 12 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.787678:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687814.787683:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687814.787689:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.787731:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed1 expref: 12 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.787744:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed1 expref: 12 pid: 6686 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687814.787760:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875574839653120:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687814.787863:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee9c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788687814.793540:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.794929:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819747200 00000100:00100000:1.0:1788687814.794943:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819747200 00010000:00010000:1.0:1788687814.794991:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c5c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed1 expref: 13 pid: 6686 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687814.795038:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:1.0:1788687814.795049:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:2349:x1875574819747200:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687814.795066:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687814.795088:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c5c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed1 expref: 13 pid: 6686 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.795104:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed1 expref: 13 pid: 6686 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.795132:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687814.795136:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687814.795145:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 13 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.795154:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 13 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.795210:0:7632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 13 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687814.795224:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe39880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7632:1875574839653248:192.168.204.26@tcp:105: 00000100:00100000:1.0:1788687814.795418:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8db33c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788687814.795694:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed1 expref: 13 pid: 6686 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.795715:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875574839653120:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687814.795744:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.795756:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3600, rc 0) 00000100:00100000:0.0:1788687814.795862:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:11624:x1875574819747072:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 8292us (8563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687814.795870:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:0.0:1788687814.803369:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.804730:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819747328 00000100:00100000:3.0:1788687814.804743:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819747328 00002000:00100000:3.0:1788687814.804804:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9af3c2e87480 x1875574819747328/t0(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:715/0 lens 504/0 e 0 to 0 dl 1788687825 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788687814.804816:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c2e87480 with x1875574819747328 ext(0->12) 00002000:00010000:3.0:1788687814.804823:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3c2e87480 00000100:00100000:3.0:1788687814.804879:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:3.0:1788687814.804890:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+12:2348:x1875574819747328:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788687814.805368:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:2348:x1875574819747328:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 Request processed in 478us (2022us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788687814.805377:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00002000:00100000:3.0:1788687814.805385:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9af3c2e87480 x1875574819747328/t4294967321(0) o4->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:715/0 lens 504/448 e 0 to 0 dl 1788687825 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788687814.805400:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c2e87480 with x1875574819747328 ext(0->12) 00002000:00010000:3.0:1788687814.805404:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3c2e87480 00000100:00100000:1.0:1788687814.805875:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe39880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7632:1875574839653248:192.168.204.26@tcp:105: 00010000:00010000:1.0:1788687814.805899:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687814.805926:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:2349:x1875574819747200:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 10879us (12396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.805935:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:2.0:1788687814.814625:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687814.814789:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819747456 00000100:00100000:3.0:1788687814.814801:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819747456 00000100:00100000:3.0:1788687814.814868:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 227 00000100:00100000:3.0:1788687814.814878:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+66:11624:x1875574819747456:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788687814.883593:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788687814.883629:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788687814.883735:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788687814.883756:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9af3ee9c1600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788687814.883763:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3ffa30300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9af3ee9c1000 00000020:00080000:0.0:1788687814.883767:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3ffa30200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9af3f7983400 00000004:00080000:0.0:1788687814.883783:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788687814.883802:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9af3c8570240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788687814.883805:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3ffa30000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9af3c8570f00 00000020:00080000:0.0:1788687814.883808:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3ffa30500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9af3ee473800 00000020:00080000:0.0:1788687814.883911:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1788687814.886478:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839653376:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788687814.886589:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687814.886694:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839653376 00000100:00100000:1.0:1788687814.886703:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839653376 00000100:00100000:1.0:1788687814.886758:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788687814.886768:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875574839653376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788687814.886799:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1788687814.886837:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9d35c5, atime: 0x6a9d35c5, ctime: 0x6a9d35c5, blocks: 0x1 00010000:00010000:1.0:1788687814.886845:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.886863:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1788687814.886868:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687814.886875:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.886907:0:6686:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.886918:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.886927:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.886946:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1788687814.887261:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788687814.887498:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839653504:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788687814.887542:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687814.887600:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839653632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788687814.887623:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687814.887648:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839653504 00000100:00100000:3.0:1788687814.887653:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839653504 00000100:00100000:3.0:1788687814.887672:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839653632 00000100:00100000:3.0:1788687814.887675:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839653632 00000100:00100000:3.0:1788687814.887685:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788687814.887692:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fbad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875574839653504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788687814.887706:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1788687814.887724:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.887753:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d39dd3/0xc2ddd83e74449a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e37 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.887761:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788687814.887764:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687814.887769:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.887795:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2d39dd3/0xc2ddd83e74449a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e37 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.887809:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2d39dd3/0xc2ddd83e74449a2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e37 expref: 12 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.887820:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3eea21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875574839653760:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687814.887876:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f3d76000 going to sleep for 11 seconds 00000100:00100000:2.0:1788687814.888156:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11624:x1875574819747456:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 73278us (73543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687814.888167:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 227 00000100:00100000:1.0:1788687814.890625:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839653376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3851us (4028us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788687814.890637:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788687814.890672:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788687814.890682:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c82e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875574839653632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788687814.890812:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788687814.890816:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788687814 00002000:00010000:1.0:1788687814.890819:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788687814.890821:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788687814 -> 1788687814 00002000:00010000:1.0:1788687814.890823:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788687814.890866:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c82e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3310:x1875574839653632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (3241us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788687814.890873:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1788687814.890907:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687814.890916:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.890935:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687814.890939:0:5827:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.890952:0:5827:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.890972:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.890981:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043e1cc76/0xc2ddd83e74449c6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.891002:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687814.891004:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687814.891006:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788687814.891653:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3fba89880/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788687814.891662:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839653632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1788687814.891834:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3c5b15c00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788687814.891840:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839653376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788687814.896568:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687814.896608:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687814.896694:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819747584 00000100:00100000:0.0:1788687814.896705:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819747584 00000100:00100000:0.0:1788687814.896766:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:0.0:1788687814.896776:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+13:2348:x1875574819747584:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788687814.896980:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819747712 00000100:00100000:1.0:1788687814.896985:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819747712 00010000:00010000:1.0:1788687814.897012:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d39dd3/0xc2ddd83e74449a2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e37 expref: 14 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687814.897041:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:1.0:1788687814.897064:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:2349:x1875574819747712:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687814.897075:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687814.897081:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2d39dd3/0xc2ddd83e74449a2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e37 expref: 14 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.897110:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2d39dd3/0xc2ddd83e74449a2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e37 expref: 14 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.897136:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788687814.897141:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788687814.897147:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.897158:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.897178:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687814.897229:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+14:2349:x1875574819747712:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 167us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687814.897237:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 83 00010000:00010000:3.0:1788687814.897632:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d39dd3/0xc2ddd83e74449a2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e37 expref: 13 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687814.897649:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3eea21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875574839653760:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687814.897670:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.897698:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.897706:0:6689:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.897715:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.897723:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.897748:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788687814.898362:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fbad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1875574839653504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10668us (10817us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788687814.898371:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1788687814.898713:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3ee90bb80/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788687814.898732:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839653504:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788687814.898797:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687814.898805:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.898826:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aade00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687814.898831:0:5828:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.898840:0:5828:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.898859:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.898870:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076378a9d/0xc2ddd83e74449c71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687814.898891:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687814.898893:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687814.898895:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788687814.973600:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:0.0:1788687814.973633:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1788687814.973649:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1788687814.973665:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1788687814.973856:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819747584:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 77073us (77238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687814.973868:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:2.0:1788687814.979283:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.979524:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819747968 00000100:00100000:1.0:1788687814.979534:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819747968 00000100:00100000:1.0:1788687814.979608:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 228 00000100:00100000:1.0:1788687814.979618:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11624:x1875574819747968:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788687814.979669:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687814.979697:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eca expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.979718:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687814.979724:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687814.979769:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.979783:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.979795:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788687814.980204:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055a68116 reply state 0000000017081c98 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687814.980215:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788687814.980320:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:11624:x1875574819747968:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 703us (1048us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788687814.980329:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 228 00000100:00100000:0.0:1788687814.988468:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:3.0:1788687814.989524:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.989538:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.989556:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.989578:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cda00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687814.989583:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.989592:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.989610:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:3.0:1788687814.989614:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687814.989618:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687814.989624:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449c78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687814.989736:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819748096 00000100:00100000:1.0:1788687814.989746:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819748096 00000100:00100000:1.0:1788687814.989792:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:1.0:1788687814.989801:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2349:x1875574819748096:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788687814.990000:0:8309:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788687814.990004:0:8309:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788687814 -> 1788687813 00002000:00010000:1.0:1788687814.990007:0:8309:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788687813 00002000:00010000:1.0:1788687814.990009:0:8309:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788687814 -> 1788687813 00002000:00010000:1.0:1788687814.990011:0:8309:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788687814.990086:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819748096:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 284us (1630us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788687814.990094:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:2.0:1788687814.996979:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687814.997177:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819748352 00000100:00100000:1.0:1788687814.997202:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819748352 00000100:00100000:1.0:1788687814.997262:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 229 00000100:00100000:1.0:1788687814.997272:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f40bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:11624:x1875574819748352:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788687814.997341:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.997457:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ebc expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.997469:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.997560:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ebc expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687814.997576:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ebc expref: 20 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687814.997591:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839653888:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687814.997916:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8db33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687815.001542:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875574839653888:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687815.001582:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687815.006814:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687815.007537:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819748480 00000100:00100000:0.0:1788687815.007559:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819748480 00010000:00010000:0.0:1788687815.007622:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ebc expref: 21 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687815.007659:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:0.0:1788687815.007671:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:2349:x1875574819748480:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687815.007687:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687815.007695:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ebc expref: 21 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.007708:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ebc expref: 21 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.007733:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449c39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ebc expref: 21 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.007753:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:0.0:1788687815.007760:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.007771:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.007797:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.007839:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687815.007900:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:2349:x1875574819748480:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 233us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687815.007909:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 84 00010000:00010000:2.0:1788687815.008147:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.008156:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.008184:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.008200:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.008206:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.008212:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687815.008216:0:5840:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.008225:0:5840:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.008234:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:2.0:1788687815.008237:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788687815.008241:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.008246:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e74449c7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687815.008291:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f40bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11624:x1875574819748352:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 Request processed in 11021us (11322us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788687815.008300:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 229 00000100:00080000:3.0:1788687815.008883:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687815.013956:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687815.014141:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819748608 00000100:00100000:3.0:1788687815.014153:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819748608 00000100:00100000:3.0:1788687815.014233:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00080000:0.0:1788687815.014242:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788687815.014246:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee47a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2348:x1875574819748608:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788687815.014294:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.014315:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.014325:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687815.014330:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788687815.014349:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.014387:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.014402:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 8 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687815.014418:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3eea20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875574839654016:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687815.015639:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c86519c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687815.018011:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3eea20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875574839654016:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687815.018045:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687815.022220:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687815.022332:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819748736 00000100:00100000:1.0:1788687815.022343:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819748736 00010000:00010000:1.0:1788687815.022386:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 9 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687815.022473:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:1.0:1788687815.022528:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee478380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+9:2348:x1875574819748736:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687815.022561:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687815.022585:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 9 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.022605:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 9 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.022633:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005390f93f/0xc2ddd83e74449c63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ed8 expref: 9 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.022650:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788687815.022655:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788687815.022661:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.022672:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.022709:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687815.022767:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee478380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2348:x1875574819748736:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 285us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687815.022775:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 85 00010000:00010000:3.0:1788687815.023256:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.023268:0:6689:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.023294:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.023301:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.023323:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.023329:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687815.023333:0:6689:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.023341:0:6689:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.023354:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.023361:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bb2e5d2/0xc2ddd83e74449c86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687815.023414:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee47a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819748608:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 9172us (9468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687815.023422:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:0.0:1788687815.031296:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687815.031413:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819748992 00000100:00100000:1.0:1788687815.031424:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819748992 00000100:00100000:1.0:1788687815.031515:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 230 00000100:00100000:1.0:1788687815.031528:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11624:x1875574819748992:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788687815.031622:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449c8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.031642:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.031653:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.031870:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.031882:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ec3 expref: 20 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.031891:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.031926:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ec3 expref: 20 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.031941:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ec3 expref: 20 pid: 8462 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687815.031956:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839654144:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687815.032246:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8db33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687815.038707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687815.038807:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839654144:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687815.038838:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687815.038905:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819749120 00000100:00100000:3.0:1788687815.038913:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819749120 00010000:00010000:3.0:1788687815.038962:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ec3 expref: 21 pid: 8462 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687815.040067:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:1.0:1788687815.040087:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c690a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:2349:x1875574819749120:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687815.040116:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687815.040127:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ec3 expref: 21 pid: 8462 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.040141:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ec3 expref: 21 pid: 8462 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.040165:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449c47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ec3 expref: 21 pid: 8462 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.040181:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:1.0:1788687815.040186:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.040196:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.040205:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.040237:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687815.040289:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c690a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:2349:x1875574819749120:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 211us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687815.040314:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 86 00010000:00010000:3.0:1788687815.040941:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.040960:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788687815.041267:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788687815.043724:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788687815.043817:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788687815.043916:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875574839654272:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788687815.044002:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687815.044031:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8620e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788687815.044147:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839654272 00000100:00100000:0.0:1788687815.044156:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839654272 00000100:00100000:0.0:1788687815.044233:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788687815.044243:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875574839654272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788687815.044315:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875574839654272:12345-0@lo:1000:mdt00_002.0 Request processed in 74us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687815.044322:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788687815.044708:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687815.044819:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788687815.044825:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788687815.044844:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3fba89880, transno 4294967322 00000100:00100000:2.0:1788687815.044907:0:5841:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9af3ee90bb80 x1875574839653504/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788687830 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687815.044919:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875574839654272:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788687815.045399:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788687815.045466:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875574839654400:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788687815.045540:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687815.045581:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c86206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687815.045895:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839654400 00000100:00100000:0.0:1788687815.045901:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839654400 00000100:00100000:0.0:1788687815.045947:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788687815.045957:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875574839654400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788687815.046153:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5841:x1875574839654400:12345-0@lo:1000:mdt00_002.0 Request processed in 198us (612us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788687815.046160:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788687815.046470:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875574839654400:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788687815.046557:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046568:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046576:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046583:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687815.046588:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046597:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046611:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3c7fb4800) 00010000:00010000:2.0:1788687815.046614:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788687815.046632:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046639:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc200/0xc2ddd83e74449c94 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046669:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046676:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046682:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046687:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687815.046690:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046696:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046704:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:2.0:1788687815.046707:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788687815.046713:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea7 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046724:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea7 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046734:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea7 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.046773:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea7 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687815.046785:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b64380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839654528:192.168.204.26@tcp:105: 00000100:00100000:2.0:1788687815.046848:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c86206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687815.053976:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687815.054153:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b64380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875574839654528:192.168.204.26@tcp:105: 00010000:00010000:2.0:1788687815.054183:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054195:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e74449bd7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054231:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449c9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054245:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449c9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054259:0:5841:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449c9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054269:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449c9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054275:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449c9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054282:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449c9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054299:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687815.054304:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449c9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054312:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449c9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054324:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:2.0:1788687815.054327:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687815.054331:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449c9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054336:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3c00/0xc2ddd83e74449c9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054346:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054363:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449c8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054371:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449c8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054376:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cce00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687815.054379:0:5841:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449c8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054385:0:5841:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449c8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054404:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:2.0:1788687815.054406:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788687815.054409:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449c8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687815.054415:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cce00/0xc2ddd83e74449c8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687815.054681:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:11624:x1875574819748992:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 23156us (23395us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788687815.054693:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 230 00000020:00080000:2.0:1788687815.054705:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788687815.054981:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788687815.054987:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788687815.055525:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788687815.055535:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788687815.056718:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819749248 00000100:00100000:1.0:1788687815.056730:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819749248 00000100:00100000:1.0:1788687815.056779:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:1.0:1788687815.056789:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:11623:x1875574819749248:12345-192.168.204.26@tcp:49:lfs.0 00000100:00100000:1.0:1788687815.056917:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:11623:x1875574819749248:12345-192.168.204.26@tcp:49:lfs.0 Request processed in 129us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687815.056925:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:2.0:1788687815.060185:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687815.061723:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819749504 00000100:00100000:3.0:1788687815.061737:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819749504 00000100:00100000:0.0:1788687815.063391:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1788687815.063405:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b92050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+23:11624:x1875574819749504:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788687815.064521:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788687815.064775:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788687815.064828:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.064843:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.064853:0:5843:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.064861:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.064867:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.064873:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.064904:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788687815.065422:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b92050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+25:11624:x1875574819749504:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 2016us (5242us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788687815.065432:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000020:00080000:0.0:1788687815.065437:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788687815.067001:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687815.067013:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.067023:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687815.067027:0:5827:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.067047:0:5827:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.067063:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9af3d2736400) 00010000:00010000:1.0:1788687815.067066:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788687815.067071:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.067077:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed000/0xc2ddd83e74449ca2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.067098:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687815.067100:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687815.067119:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687815.068936:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687815.069140:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819749760 00000100:00100000:3.0:1788687815.069149:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819749760 00000100:00100000:3.0:1788687815.069209:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 231 00000100:00100000:3.0:1788687815.069220:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+25:11623:x1875574819749760:12345-192.168.204.26@tcp:58:lfs.0 00000040:00080000:3.0:1788687815.069472:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788687815.069612:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+25:11623:x1875574819749760:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 393us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687815.069620:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 231 00000100:00100000:2.0:1788687815.099993:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687815.100078:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819749888 00000100:00100000:3.0:1788687815.100088:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819749888 00000100:00100000:3.0:1788687815.100143:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 232 00000100:00100000:3.0:1788687815.100154:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+25:11626:x1875574819749888:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687815.100178:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687815.100204:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449ca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462edf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.100288:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449cb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.100302:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.100314:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.100329:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449cb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.100336:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687815.100343:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.102589:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.102611:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea0 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.102630:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.102667:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea0 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.102684:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea0 expref: 26 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687815.102700:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee478e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839654656:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687815.102804:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c1900 going to sleep for 11 seconds 00000100:00100000:1.0:1788687815.106110:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687815.106211:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819750144 00000100:00100000:2.0:1788687815.106220:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819750144 00000100:00100000:2.0:1788687815.106281:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:2.0:1788687815.106291:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:9241:x1875574819750144:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788687815.106598:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:9241:x1875574819750144:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 307us (496us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788687815.106606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:0.0:1788687815.107345:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee478e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875574839654656:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687815.107382:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687815.110111:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687815.110226:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819750272 00000100:00100000:1.0:1788687815.110235:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819750272 00010000:00010000:1.0:1788687815.110274:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea0 expref: 28 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687815.110313:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:1.0:1788687815.110324:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:2348:x1875574819750272:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687815.110339:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687815.110346:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea0 expref: 28 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.110368:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea0 expref: 28 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.110389:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3c13ed800/0xc2ddd83e74449bc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea0 expref: 28 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.110407:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687815.110412:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.110421:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.110429:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687815.110455:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687815.110571:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+27:2348:x1875574819750272:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 249us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687815.110579:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 87 00010000:00010000:0.0:1788687815.111882:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.111897:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687815.111944:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788687815.111949:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687815.111970:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.111994:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112023:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112029:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449cb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112037:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112047:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687815.112052:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112059:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112071:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:0.0:1788687815.112074:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687815.112078:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449cb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112085:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac600/0xc2ddd83e74449cb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112100:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112107:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449cb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112113:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112124:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687815.112127:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112134:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112142:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9af3ca87c700) 00010000:00010000:0.0:1788687815.112144:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687815.112147:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449cb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112153:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad400/0xc2ddd83e74449cb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112196:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac800/0xc2ddd83e74449ca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462edf expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112212:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462edf expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687815.112219:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:0.0:1788687815.112222:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788687815.112224:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec600, rc 0) 00000100:00100000:0.0:1788687815.112282:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:11626:x1875574819749888:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 12129us (12298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687815.112290:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 232 00010000:00010000:2.0:1788687815.183229:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687815.662233:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687815.662277:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687815.662304:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819750528 00000100:00100000:2.0:1788687815.662311:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687815.662313:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819750528 00000100:00100000:1.0:1788687815.662387:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:1.0:1788687815.662397:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2347:x1875574819750528:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687815.662438:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819750400 00000100:00100000:0.0:1788687815.662447:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819750400 00000100:00100000:1.0:1788687815.662477:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2347:x1875574819750528:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 82us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687815.662504:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:0.0:1788687815.662505:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 296 00000100:00100000:0.0:1788687815.662513:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819750400:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:1.0:1788687815.662545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788687815.662550:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2347:x1875574819750400:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 38us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687815.662556:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 296 00000100:00100000:3.0:1788687815.663215:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819750656 00000100:00100000:3.0:1788687815.663220:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819750656 00000100:00080000:1.0:1788687815.663312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687815.663795:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 154 00000100:00100000:3.0:1788687815.663806:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819750656:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687815.663854:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2347:x1875574819750656:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 51us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687815.663861:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 154 00000040:00080000:0.0:1788687815.855420:0:12611:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788687815.855429:0:12611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788687815.855582:0:12611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788687815.855589:0:12611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788687816.069763:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788687816.069772:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788687816.069830:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788687816.069838:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788687816.069979:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3eea20e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839654784:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788687816.070113:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fc1c1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788687816.078969:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687816.079105:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3eea20e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1875574839654784:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788687816.080220:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819750784 00000100:00100000:2.0:1788687816.080233:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819750784 00000100:00100000:2.0:1788687816.080306:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 233 00000100:00100000:2.0:1788687816.080408:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:11638:x1875574819750784:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788687816.080452:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788687816.080608:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:11638:x1875574819750784:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 291us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687816.080617:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 233 00000100:00100000:2.0:1788687816.085574:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687816.085675:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819751040 00000100:00100000:1.0:1788687816.085684:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819751040 00000100:00100000:1.0:1788687816.085738:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 234 00000100:00100000:1.0:1788687816.085749:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+26:11638:x1875574819751040:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687816.085769:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687816.085790:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449cc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ee6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687816.085908:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449ccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687816.085922:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687816.085935:0:5840:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687816.085961:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788687816.086167:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd000/0xc2ddd83e74449cc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ee6 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687816.086187:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ee6 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687816.086195:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687816.086198:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687816.086202:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cda00, rc 0) 00000100:00100000:1.0:1788687816.087449:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:11638:x1875574819751040:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1696us (1880us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788687816.087460:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 234 00000100:00100000:1.0:1788687816.107398:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687816.107517:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819751296 00000100:00100000:0.0:1788687816.107539:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819751296 00000100:00100000:0.0:1788687816.107610:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 235 00000100:00100000:0.0:1788687816.107621:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:11638:x1875574819751296:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788687816.107705:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:0.0:1788687816.107718:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449cda lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687816.107737:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687816.107751:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687816.107944:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687816.107953:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449cda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687816.107960:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449cda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687816.107981:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687816.107985:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449cda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687816.108005:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449cda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687816.108018:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:0.0:1788687816.108021:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788687816.108026:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449cda lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687816.108032:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e74449cda lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687816.108205:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:11638:x1875574819751296:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 584us (817us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788687816.108213:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 235 00000040:00080000:3.0:1788687816.108304:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788687816.108308:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788687816.108881:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819751424 00000100:00100000:1.0:1788687816.108888:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819751424 00000100:00100000:1.0:1788687816.108925:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:1.0:1788687816.108932:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:2349:x1875574819751424:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687816.108943:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687816.108959:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cda00/0xc2ddd83e74449ccc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ee6 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687816.108973:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687816.108977:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687816.109017:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:2349:x1875574819751424:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 85us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687816.109036:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000040:00080000:3.0:1788687816.112692:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788687816.112712:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788687816.116304:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687816.116376:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819751680 00000100:00100000:2.0:1788687816.116387:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819751680 00000100:00100000:2.0:1788687816.116451:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:2.0:1788687816.116460:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+28:11638:x1875574819751680:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788687816.116737:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:11638:x1875574819751680:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 278us (443us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788687816.116746:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00010000:00010000:1.0:1788687816.198864:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687817.221854:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788687817.687979:0:12665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788687817.687989:0:12665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788687817.688036:0:12665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788687817.688043:0:12665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788687817.941647:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687817.941734:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819751936 00000100:00100000:0.0:1788687817.941746:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819751936 00000100:00100000:0.0:1788687817.941824:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 236 00000100:00100000:0.0:1788687817.941838:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+29:11658:x1875574819751936:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687817.941862:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687817.941888:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74449ce1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462eed expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687817.942009:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449ce8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687817.942039:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687817.942054:0:8462:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687817.942066:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788687817.942202:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eda00/0xc2ddd83e74449ce1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eed expref: 32 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687817.942223:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eed expref: 31 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687817.942231:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:0.0:1788687817.942235:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788687817.942238:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ede00, rc 0) 00000100:00100000:0.0:1788687817.942299:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+31:11658:x1875574819751936:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 465us (663us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788687817.942306:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 236 00000100:00080000:1.0:1788687817.942626:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687817.945621:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687817.945689:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819752064 00000100:00100000:1.0:1788687817.945699:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819752064 00000100:00100000:1.0:1788687817.945756:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 237 00000100:00100000:1.0:1788687817.945767:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+31:11658:x1875574819752064:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:1.0:1788687817.945834:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687817.945850:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687817.945862:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687817.945887:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687817.945894:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449cf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687817.945901:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687817.945907:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc000 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687817.945911:0:5839:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687817.945930:0:5839:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687817.945942:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:1.0:1788687817.945945:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788687817.945950:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449cf6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687817.945957:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e74449cf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687817.946041:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+31:11658:x1875574819752064:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 275us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687817.946049:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 237 00000100:00100000:0.0:1788687818.099547:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687818.099650:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819752192 00000100:00100000:1.0:1788687818.099661:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819752192 00000100:00100000:1.0:1788687818.099744:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:1.0:1788687818.099756:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2347:x1875574819752192:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:1.0:1788687818.099778:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687818.099801:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd3c6352/0xc2ddd83e74449cfd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ef4 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687818.099832:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9d35c5, atime: 0x6a9d35c5, ctime: 0x6a9d35c5, blocks: 0xb 00010000:00010000:1.0:1788687818.099856:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1788687818.099861:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687818.099873:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c6352/0xc2ddd83e74449cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ef4 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687818.099923:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c6352/0xc2ddd83e74449cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ef4 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687818.099938:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc000, rc 0) 00000100:00100000:1.0:1788687818.100032:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2347:x1875574819752192:12345-192.168.204.26@tcp:101:cat.0 Request processed in 279us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687818.100039:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00080000:3.0:1788687818.100157:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788687818.107641:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687818.107766:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819752320 00000100:00100000:2.0:1788687818.107776:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819752320 00002000:00100000:2.0:1788687818.107839:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9af3c315ce00 x1875574819752320/t0(0) o3->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:719/0 lens 488/0 e 0 to 0 dl 1788687829 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788687818.107850:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c315ce00 with x1875574819752320 ext(0->4095) 00002000:00010000:2.0:1788687818.107859:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3c315ce00 00000100:00100000:2.0:1788687818.107897:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788687818.107908:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819752320:12345-192.168.204.26@tcp:3:cat.0 00000100:00100000:2.0:1788687818.108155:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+8:2349:x1875574819752320:12345-192.168.204.26@tcp:3:cat.0 Request processed in 247us (529us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788687818.108163:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00002000:00100000:2.0:1788687818.108170:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9af3c315ce00 x1875574819752320/t0(0) o3->bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f@192.168.204.26@tcp:719/0 lens 488/4536 e 0 to 0 dl 1788687829 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788687818.108178:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9af3c315ce00 with x1875574819752320 ext(0->4095) 00002000:00010000:2.0:1788687818.108181:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9af3c315ce00 00010000:00010000:1.0:1788687818.246010:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687818.823732:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c2e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839654912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687818.823805:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687818.824170:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839655424:0@lo:400:kworker.0 00000100:00100000:3.0:1788687818.824201:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687818.824225:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788687818.824231:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839655296:0@lo:400:kworker.0 00000100:00100000:3.0:1788687818.824254:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687818.824617:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839655424 00000100:00100000:2.0:1788687818.824625:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839655424 00000100:00100000:2.0:1788687818.824676:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839655296 00000100:00100000:2.0:1788687818.824680:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839655296 00000100:00100000:2.0:1788687818.824701:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788687818.824709:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839655424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687818.824760:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839655424:12345-0@lo:400:kworker.0 Request processed in 51us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687818.824766:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788687818.824782:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788687818.824787:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839655296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687818.824809:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839655296:12345-0@lo:400:kworker.0 Request processed in 22us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687818.824814:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788687818.825118:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839654912 00000100:00100000:0.0:1788687818.825122:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839654912 00000100:00100000:0.0:1788687818.825160:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788687818.825167:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c315f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875574839654912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788687818.825195:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687818.825241:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c315f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875574839654912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687818.825260:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788687818.825282:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839655040:0@lo:400:kworker.0 00000100:00100000:0.0:1788687818.825322:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687818.825347:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839655552:0@lo:400:kworker.0 00000100:00100000:0.0:1788687818.825378:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687818.825397:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788687818.825402:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839655168:0@lo:400:kworker.0 00000100:00100000:0.0:1788687818.825420:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687818.825444:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839655168 00000100:00100000:0.0:1788687818.825447:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839655168 00000100:00100000:0.0:1788687818.825465:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788687818.825497:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839655168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687818.825528:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839655168:12345-0@lo:400:kworker.0 Request processed in 58us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687818.825535:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1788687818.825858:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788687818.825862:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687818.825894:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839655296:0@lo:400:kworker.0 00000100:00100000:3.0:1788687818.825905:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839655424:0@lo:400:kworker.0 00000100:00100000:3.0:1788687818.826343:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c2e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839654912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687818.826792:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839655040 00000100:00100000:0.0:1788687818.826798:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839655040 00000100:00100000:0.0:1788687818.826829:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788687818.826836:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839655040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687818.826878:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3312:x1875574839655040:12345-0@lo:400:kworker.0 Request processed in 42us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687818.826884:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788687818.829055:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839655168:0@lo:400:kworker.0 00000100:00100000:2.0:1788687818.829069:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839655040:0@lo:400:kworker.0 00000100:00100000:0.0:1788687818.829392:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839655552 00000100:00100000:0.0:1788687818.829398:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839655552 00000100:00100000:0.0:1788687818.829456:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788687818.829464:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839655552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687818.829563:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875574839655552:12345-0@lo:400:kworker.0 Request processed in 99us (4183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687818.829569:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788687818.829601:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839655552:0@lo:400:kworker.0 00000100:00080000:2.0:1788687818.838757:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788687818.859737:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788687818.859754:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1788687819.270020:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687819.335251:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c3119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839655680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687819.335317:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687819.336597:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839655680 00000100:00100000:0.0:1788687819.336608:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839655680 00000100:00100000:0.0:1788687819.336857:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788687819.336868:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875574839655680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788687819.337001:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687819.337072:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875574839655680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 205us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687819.337079:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788687819.337158:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c3119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839655680:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788687819.956541:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788687819.957702:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788687819.957732:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9af3c8620e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788687819.957737:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3ffa30a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9af3c8620900 00000020:00080000:3.0:1788687819.957740:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9af3ffa30e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9af3f7981000 00000020:00080000:0.0:1788687819.958227:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788687819.958432:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788687820.294412:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788687820.437674:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1788687820.437689:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:2.0:1788687820.789608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687820.789721:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687820.789760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687820.789800:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687820.789828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687820.789866:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819752960 00000100:00100000:2.0:1788687820.789880:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819752960 00000100:00100000:1.0:1788687820.790139:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819752704 00000100:00100000:1.0:1788687820.790144:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819752704 00000100:00100000:2.0:1788687820.790230:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819752576 00000100:00100000:2.0:1788687820.790234:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819752576 00000100:00100000:0.0:1788687820.790271:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819752448 00000100:00100000:0.0:1788687820.790276:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819752448 00000100:00100000:0.0:1788687820.790316:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 298 00000100:00100000:0.0:1788687820.790329:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2348:x1875574819752448:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687820.790428:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2348:x1875574819752448:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 100us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687820.790448:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 298 00000100:00100000:1.0:1788687820.790625:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819752832 00000100:00100000:1.0:1788687820.790629:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819752832 00000100:00100000:1.0:1788687820.790658:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:1.0:1788687820.790667:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819752704:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687820.790704:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2348:x1875574819752704:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 39us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687820.790711:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:1.0:1788687820.790724:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:1.0:1788687820.790730:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819752832:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687820.790764:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2348:x1875574819752832:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 34us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687820.791064:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:2.0:1788687820.791190:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 158 00000100:00100000:2.0:1788687820.791198:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2348:x1875574819752960:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687820.791242:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e3c77f5-0083-4021-afe4-5890473fab59+5:2348:x1875574819752960:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 45us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687820.791258:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 158 00000100:00100000:2.0:1788687820.791275:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 159 00000100:00100000:2.0:1788687820.791282:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:2348:x1875574819752576:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687820.791312:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:2348:x1875574819752576:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 31us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687820.791318:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 159 00000100:00080000:2.0:1788687820.791346:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788687820.791350:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788687820.791353:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788687821.317797:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687822.341777:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788687823.305367:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788687823.305381:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788687823.305858:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788687823.305867:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788687823.367043:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687823.389175:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687823.389352:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819753088 00000100:00100000:2.0:1788687823.389366:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819753088 00000100:00100000:2.0:1788687823.389561:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 238 00000100:00100000:2.0:1788687823.389575:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11303:x1875574819753088:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788687823.389723:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11303:x1875574819753088:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 Request processed in 151us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687823.389734:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 238 00000100:00080000:0.0:1788687823.392977:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687823.394653:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687823.394745:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819753344 00000100:00100000:1.0:1788687823.394760:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819753344 00000100:00100000:1.0:1788687823.394850:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:1.0:1788687823.394865:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c2e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:11303:x1875574819753344:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788687823.395352:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c2e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:11303:x1875574819753344:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 488us (718us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788687823.395362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:1.0:1788687823.642425:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687823.642733:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819753472 00000100:00100000:2.0:1788687823.642748:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819753472 00000100:00080000:1.0:1788687823.642902:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687823.643018:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 239 00000100:00100000:2.0:1788687823.643033:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+5:12111:x1875574819753472:12345-192.168.204.26@tcp:101:lsof.0 00010000:00010000:2.0:1788687823.643064:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687823.643094:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449d04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462efb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687823.643183:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449d0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687823.643202:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687823.643215:0:5839:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687823.643264:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788687823.643268:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687823.643294:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687823.643347:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d3e00/0xc2ddd83e74449d04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462efb expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687823.643371:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449d0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462efb expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687823.643394:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:2.0:1788687823.643397:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788687823.643402:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2000, rc 0) 00000100:00100000:2.0:1788687823.643567:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+6:12111:x1875574819753472:12345-192.168.204.26@tcp:101:lsof.0 Request processed in 537us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687823.643576:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 239 00000100:00100000:2.0:1788687823.942062:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788687823.942100:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839655808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788687823.942226:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687823.942352:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839655808 00000100:00100000:2.0:1788687823.942362:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839655808 00000100:00100000:2.0:1788687823.942452:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788687823.942463:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839655808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788687823.942548:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687823.942604:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839655808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687823.942612:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788687823.942664:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788687823.942672:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788687823.942698:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3c5b15c00, transno 4294967310 00000100:00100000:2.0:1788687823.942742:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839655808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687823.945175:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839656192:0@lo:400:kworker.0 00000100:00100000:3.0:1788687823.945289:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687823.945962:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839656064:0@lo:400:kworker.0 00000100:00100000:0.0:1788687823.946027:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687823.946094:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839656320:0@lo:400:kworker.0 00000100:00100000:0.0:1788687823.946122:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687823.946173:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839655936:0@lo:400:kworker.0 00000100:00100000:0.0:1788687823.946209:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687823.946758:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839656192 00000100:00100000:3.0:1788687823.946771:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839656192 00000100:00100000:3.0:1788687823.946858:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839656064 00000100:00100000:3.0:1788687823.946862:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839656064 00000100:00100000:3.0:1788687823.946876:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839656320 00000100:00100000:3.0:1788687823.946878:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839656320 00000100:00100000:3.0:1788687823.946898:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788687823.946908:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839656192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687823.947003:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839656192:12345-0@lo:400:kworker.0 Request processed in 95us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687823.947013:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788687823.947034:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788687823.947041:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839656064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687823.947076:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839656064:12345-0@lo:400:kworker.0 Request processed in 36us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687823.947082:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788687823.947116:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788687823.947122:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c311b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839656320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687823.947170:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c311b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839656320:12345-0@lo:400:kworker.0 Request processed in 48us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687823.947176:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1788687823.947176:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788687823.947184:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687823.947220:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839656064:0@lo:400:kworker.0 00000100:00100000:1.0:1788687823.947238:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ee90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839656448:0@lo:400:kworker.0 00000100:00100000:3.0:1788687823.947265:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839656320:0@lo:400:kworker.0 00000100:00100000:1.0:1788687823.947279:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687823.947291:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839656192:0@lo:400:kworker.0 00000100:00100000:1.0:1788687823.947324:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839656448 00000100:00100000:1.0:1788687823.947328:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839656448 00000100:00100000:3.0:1788687823.947351:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839655936 00000100:00100000:3.0:1788687823.947356:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839655936 00000100:00100000:1.0:1788687823.947366:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788687823.947383:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839656448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687823.947393:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788687823.947399:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3311:x1875574839655936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687823.947421:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839656448:12345-0@lo:400:kworker.0 Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687823.947428:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3311:x1875574839655936:12345-0@lo:400:kworker.0 Request processed in 30us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687823.947428:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788687823.947434:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788687823.947457:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839655936:0@lo:400:kworker.0 00000100:00100000:1.0:1788687823.947468:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1788687823.947474:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3ee90bb80, transno 4294967323 00000004:00080000:1.0:1788687823.947520:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1788687823.947540:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ee90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839656448:0@lo:400:kworker.0 00000100:00080000:1.0:1788687823.947555:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788687824.392086:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687824.454050:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c3119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839656576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687824.454162:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687824.454311:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839656576 00000100:00100000:1.0:1788687824.454324:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839656576 00000100:00100000:1.0:1788687824.454402:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788687824.454415:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839656576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687824.454469:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687824.454556:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839656576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687824.454564:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788687824.454699:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c3119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839656576:0@lo:13:osp-pre-1-0.0 00000020:00080000:2.0:1788687825.017609:0:12731:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1788687825.017642:0:12731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788687825.017751:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788687825.017763:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788687825.415129:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687825.904073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687825.904179:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687825.904219:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687825.904258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687825.904283:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687825.904853:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819753600 00000100:00100000:0.0:1788687825.904865:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819753600 00000100:00100000:0.0:1788687825.904923:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 300 00000100:00100000:0.0:1788687825.904936:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819753600:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687825.905267:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819753600:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 332us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687825.905276:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 300 00000100:00100000:1.0:1788687825.905542:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819753856 00000100:00100000:1.0:1788687825.905550:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819753856 00000100:00100000:2.0:1788687825.905576:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819754112 00000100:00100000:2.0:1788687825.905583:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819754112 00000100:00100000:1.0:1788687825.905603:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819753984 00000100:00100000:1.0:1788687825.905608:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819753984 00000100:00100000:2.0:1788687825.905626:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819753728 00000100:00100000:2.0:1788687825.905631:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819753728 00000100:00100000:1.0:1788687825.905640:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:1.0:1788687825.905651:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819753856:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687825.905668:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 163 00000100:00100000:2.0:1788687825.905679:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+6:2346:x1875574819754112:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687825.905693:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819753856:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687825.905701:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:2.0:1788687825.905719:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e3c77f5-0083-4021-afe4-5890473fab59+6:2346:x1875574819754112:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 42us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687825.905727:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 163 00000100:00100000:2.0:1788687825.905742:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 164 00000100:00100000:2.0:1788687825.905749:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:2346:x1875574819753728:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687825.905778:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:2346:x1875574819753728:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 31us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687825.905784:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 164 00000100:00100000:2.0:1788687825.905804:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:2.0:1788687825.905811:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2346:x1875574819753984:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:1.0:1788687825.907031:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788687825.907039:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788687825.907042:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788687825.907143:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2346:x1875574819753984:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1326us (2852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687825.907154:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 91 00010000:00010000:1.0:1788687826.437764:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788687827.326259:0:12873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 05:43:45 (1788687825) 00010000:00010000:2.0:1788687827.465257:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687828.485738:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687829.061832:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839656704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687829.061904:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687829.062391:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839656704 00000100:00100000:2.0:1788687829.062401:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839656704 00000100:00100000:2.0:1788687829.062459:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788687829.062469:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c3119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839656704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788687829.062522:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687829.062578:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c3119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839656704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687829.062585:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788687829.062682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788687829.069512:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839656832:0@lo:400:kworker.0 00000100:00100000:0.0:1788687829.069594:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687829.069639:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839657344:0@lo:400:kworker.0 00000100:00100000:0.0:1788687829.069685:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687829.069725:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788687829.069732:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839656960:0@lo:400:kworker.0 00000100:00100000:0.0:1788687829.069757:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687829.069813:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839657088:0@lo:400:kworker.0 00000100:00100000:0.0:1788687829.069842:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687829.069861:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788687829.069866:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839657216:0@lo:400:kworker.0 00000100:00100000:0.0:1788687829.069888:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687829.069923:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839656832 00000100:00100000:0.0:1788687829.069930:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839656832 00000100:00100000:2.0:1788687829.069962:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839656960 00000100:00100000:2.0:1788687829.069970:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839656960 00000100:00100000:0.0:1788687829.069985:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788687829.069996:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839656832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687829.070007:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839657088 00000100:00100000:2.0:1788687829.070012:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839657088 00000100:00100000:0.0:1788687829.070046:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839656832:12345-0@lo:400:kworker.0 Request processed in 53us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687829.070054:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788687829.070085:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839657344 00000100:00100000:0.0:1788687829.070089:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839657344 00000100:00100000:2.0:1788687829.070113:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839657216 00000100:00100000:2.0:1788687829.070118:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839657216 00000100:00100000:0.0:1788687829.070144:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788687829.070148:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788687829.070156:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839657344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687829.070162:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839656960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687829.070606:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839657344:12345-0@lo:400:kworker.0 Request processed in 450us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687829.070614:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788687829.070619:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839656960:12345-0@lo:400:kworker.0 Request processed in 460us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687829.070629:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788687829.070645:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788687829.070656:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839657088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687829.070659:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788687829.070669:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839657216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687829.070710:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875574839657216:12345-0@lo:400:kworker.0 Request processed in 44us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687829.070716:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788687829.070790:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839657088:12345-0@lo:400:kworker.0 Request processed in 137us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687829.070797:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788687829.070848:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839656960:0@lo:400:kworker.0 00000100:00100000:0.0:1788687829.070861:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839656832:0@lo:400:kworker.0 00000100:00100000:2.0:1788687829.070873:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839657216:0@lo:400:kworker.0 00000100:00100000:0.0:1788687829.070893:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839657344:0@lo:400:kworker.0 00000100:00100000:2.0:1788687829.070896:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839657088:0@lo:400:kworker.0 00000100:00100000:2.0:1788687829.070964:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839656704:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788687829.072577:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788687829.072584:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788687829.512212:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687829.573811:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687829.573838:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839657472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687829.573913:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687829.574105:0:8207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839657472 00000100:00100000:3.0:1788687829.574115:0:8207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839657472 00000100:00100000:3.0:1788687829.574169:0:8207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788687829.574180:0:8207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839657472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788687829.574221:0:8207:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687829.574285:0:8207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839657472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687829.574293:0:8207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788687829.574899:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839657472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788687830.533807:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687831.021089:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687831.021136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687831.021170:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687831.021201:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687831.021248:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687831.021279:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819754624 00000100:00100000:1.0:1788687831.021283:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819754496 00000100:00100000:0.0:1788687831.021290:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819754624 00000100:00100000:1.0:1788687831.021300:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819754496 00000100:00100000:1.0:1788687831.021351:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:1.0:1788687831.021361:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819754496:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788687831.021370:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819754368 00000100:00100000:2.0:1788687831.021374:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819754368 00000100:00100000:2.0:1788687831.021403:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819754752 00000100:00100000:2.0:1788687831.021405:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819754752 00000100:00100000:2.0:1788687831.021425:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 168 00000100:00100000:1.0:1788687831.021430:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2346:x1875574819754496:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687831.021431:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:2346:x1875574819754368:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687831.021438:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:3.0:1788687831.021520:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819754240 00000100:00100000:3.0:1788687831.021524:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819754240 00000100:00100000:3.0:1788687831.021552:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 302 00000100:00100000:3.0:1788687831.021558:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819754240:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687831.021583:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2346:x1875574819754240:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687831.021590:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 302 00000100:00080000:3.0:1788687831.021626:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788687831.021630:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788687831.021632:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788687831.021674:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00100000:3.0:1788687831.021682:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e3c77f5-0083-4021-afe4-5890473fab59+6:2346:x1875574819754752:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687831.021706:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e3c77f5-0083-4021-afe4-5890473fab59+6:2346:x1875574819754752:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687831.021711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00100000:2.0:1788687831.021938:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:2346:x1875574819754368:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 506us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687831.021946:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 168 00000100:00100000:0.0:1788687831.029052:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:0.0:1788687831.029080:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2346:x1875574819754624:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687831.029176:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2346:x1875574819754624:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 111us (8038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687831.029184:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:3.0:1788687831.119696:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687831.119844:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819755008 00000100:00100000:0.0:1788687831.119858:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819755008 00000100:00100000:0.0:1788687831.119938:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:0.0:1788687831.119951:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+18:12332:x1875574819755008:12345-192.168.204.26@tcp:35:umount.0 00000100:00100000:0.0:1788687831.120570:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:12332:x1875574819755008:12345-192.168.204.26@tcp:35:umount.0 Request processed in 619us (886us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788687831.120580:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:3.0:1788687831.126406:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687831.127133:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819755264 00000100:00100000:0.0:1788687831.127149:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819755264 00000100:00100000:0.0:1788687831.127253:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:0.0:1788687831.127266:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+19:12332:x1875574819755264:12345-192.168.204.26@tcp:35:umount.0 00000100:00100000:0.0:1788687831.128382:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:12332:x1875574819755264:12345-192.168.204.26@tcp:35:umount.0 Request processed in 1112us (1985us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788687831.128394:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:2.0:1788687831.131818:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687831.131953:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819755520 00000100:00100000:1.0:1788687831.132073:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819755520 00000100:00100000:1.0:1788687831.132156:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:1.0:1788687831.132169:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3e6b92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+20:12332:x1875574819755520:12345-192.168.204.26@tcp:35:umount.0 00000100:00100000:1.0:1788687831.132650:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3e6b92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:12332:x1875574819755520:12345-192.168.204.26@tcp:35:umount.0 Request processed in 482us (848us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788687831.132670:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:2.0:1788687831.142797:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687831.143022:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819755776 00000100:00100000:0.0:1788687831.143036:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819755776 00000100:00100000:0.0:1788687831.143111:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:0.0:1788687831.143122:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+21:12332:x1875574819755776:12345-192.168.204.26@tcp:35:umount.0 00000100:00100000:0.0:1788687831.144167:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:12332:x1875574819755776:12345-192.168.204.26@tcp:35:umount.0 Request processed in 1040us (1380us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788687831.144188:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:2.0:1788687831.150148:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687831.150278:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819756160 00000100:00100000:3.0:1788687831.150291:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819756160 00000100:00100000:3.0:1788687831.150406:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:3.0:1788687831.150420:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2345:x1875574819756160:12345-192.168.204.26@tcp:9:umount.0 00000020:00000080:3.0:1788687831.150469:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e744492c3 00000020:00010000:3.0:1788687831.150523:0:6686:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9af3d2b02800: total 0 00000100:00080000:3.0:1788687831.150530:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9af3c882f800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788687831.150725:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687831.150765:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687831.150807:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687831.150831:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819756416 00000100:00100000:2.0:1788687831.150835:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819756416 00000100:00100000:2.0:1788687831.150875:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819756288 00000100:00100000:2.0:1788687831.150878:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819756288 00000100:00100000:2.0:1788687831.150891:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819756544 00000100:00100000:2.0:1788687831.150893:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819756544 00000100:00100000:2.0:1788687831.150907:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:2.0:1788687831.150914:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+15:2348:x1875574819756416:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687831.150945:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788687831.151115:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788687831.151126:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+15:2348:x1875574819756288:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687831.151136:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687831.151152:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aac000/0xc2ddd83e74448d83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a86 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687831.151171:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687831.151262:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+14:2348:x1875574819756288:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 138us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687831.151270:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788687831.151290:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:1.0:1788687831.151296:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+13:2348:x1875574819756544:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687831.151313:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687831.151323:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f15d3400/0xc2ddd83e74448f97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b51 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687831.151334:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687831.151353:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:2348:x1875574819756544:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 58us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687831.151359:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00010000:00010000:2.0:1788687831.151503:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d9400/0xc2ddd83e74448ce9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a4e expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687831.151515:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687831.151536:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2348:x1875574819756416:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 623us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687831.151543:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000001:00000004:3.0:1788687831.151704:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788687831.152279:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2345:x1875574819756160:12345-192.168.204.26@tcp:9:umount.0 Request processed in 1858us (2325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687831.152289:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00000020:00010000:2.0:1788687831.153081:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9af3d2b02800: total 0 00010000:00010000:2.0:1788687831.153128:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9af3d2b02800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788687831.153272:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444965f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d26 expref: 4 pid: 8309 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687831.153315:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3c6352/0xc2ddd83e74449cfd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ef4 expref: 3 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687831.153332:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9af3d2b02800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788687831.153346:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687831.153348:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687831.153350:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687831.160113:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687831.160278:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819756672 00000100:00100000:0.0:1788687831.160291:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819756672 00000100:00100000:0.0:1788687831.160402:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:0.0:1788687831.160416:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+5:2345:x1875574819756672:12345-192.168.204.26@tcp:9:umount.0 00000020:00000080:0.0:1788687831.160472:0:8309:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e7444905b 00000100:00080000:0.0:1788687831.160522:0:8309:0:(import.c:65:import_set_state_nolock()) ffff9af3fc391000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788687831.160865:0:8309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788687831.161429:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+2:2345:x1875574819756672:12345-192.168.204.26@tcp:9:umount.0 Request processed in 1013us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687831.161439:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 74 00010000:00010000:2.0:1788687831.161638:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687831.173313:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687831.173472:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819757696 00000100:00100000:3.0:1788687831.173530:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819757696 00000100:00100000:3.0:1788687831.173605:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 240 00000100:00100000:3.0:1788687831.173618:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+22:2345:x1875574819757696:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:3.0:1788687831.173663:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448cf7 00000020:00010000:3.0:1788687831.173693:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9af3c83c1000: total 0 00000100:00080000:3.0:1788687831.173700:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9af3fbbfd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788687831.173744:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1788687831.174140:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9af3c83c1000: total 0 00010000:00010000:0.0:1788687831.174146:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687831.174221:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9af3c83c1000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788687831.174275:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:0.0:1788687831.174279:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687831.174307:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e744496c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d42 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174334:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3d2736300) 00010000:00010000:0.0:1788687831.174336:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687831.174341:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed400/0xc2ddd83e74448fdd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b66 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174362:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:0.0:1788687831.174364:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788687831.174368:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ede00/0xc2ddd83e74449ce8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462eed expref: 19 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174381:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:0.0:1788687831.174384:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788687831.174388:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e74449620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d11 expref: 18 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174399:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:0.0:1788687831.174402:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788687831.174405:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444964a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d1f expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174416:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:0.0:1788687831.174418:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788687831.174420:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec600/0xc2ddd83e74449cbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462edf expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174432:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687831.174440:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788687831.174445:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444931e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462c4d expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174459:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9af3c7fb4c00) 00010000:00010000:0.0:1788687831.174461:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687831.174465:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cdc00/0xc2ddd83e74448fc1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b5f expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174501:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:0.0:1788687831.174504:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788687831.174508:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec200/0xc2ddd83e744499bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462e1b expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174519:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9af3c7fb4000) 00010000:00010000:0.0:1788687831.174522:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788687831.174525:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cca00/0xc2ddd83e74449031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b7b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174538:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9af3c7fb4100) 00010000:00010000:0.0:1788687831.174540:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788687831.174542:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e74449bde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ea7 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174556:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9af3e29fe100) 00010000:00010000:0.0:1788687831.174558:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788687831.174561:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2c00/0xc2ddd83e744496dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462d49 expref: 10 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174589:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9af3ca87c500) 00010000:00010000:0.0:1788687831.174592:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788687831.174596:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e74449540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462cd9 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687831.174609:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9af3c83c1000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788687831.174624:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687831.174626:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687831.174628:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687831.175400:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f+7:2345:x1875574819757696:12345-192.168.204.26@tcp:39:umount.0 Request processed in 1776us (2093us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788687831.175414:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 240 00010000:00010000:2.0:1788687831.557746:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687832.585259:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687833.014600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687833.014647:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687833.014724:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687833.014779:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819757952 00000100:00100000:3.0:1788687833.014790:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819757952 00000100:00100000:3.0:1788687833.014849:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819757824 00000100:00100000:3.0:1788687833.014853:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819757824 00000100:00100000:3.0:1788687833.014866:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819758080 00000100:00100000:3.0:1788687833.014868:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819758080 00000100:00100000:3.0:1788687833.014885:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:3.0:1788687833.014896:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+12:2349:x1875574819757952:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687833.014917:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687833.014949:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38cd800/0xc2ddd83e74448dd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ac5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687833.014972:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687833.015041:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+11:2349:x1875574819757952:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 146us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687833.015048:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:3.0:1788687833.015069:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788687833.015075:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c56d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+10:2349:x1875574819757824:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687833.015083:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687833.015092:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38ccc00/0xc2ddd83e74448dc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a9b expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687833.015102:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687833.015119:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c56d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+9:2349:x1875574819757824:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 45us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687833.015125:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788687833.015167:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:3.0:1788687833.015173:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+8:2349:x1875574819758080:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687833.015188:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687833.015211:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74448f90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462b4a expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687833.015220:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687833.015239:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+7:2349:x1875574819758080:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 66us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687833.015244:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:0.0:1788687833.020106:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687833.020248:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819758336 00000100:00100000:3.0:1788687833.020270:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819758336 00000100:00100000:3.0:1788687833.020358:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 241 00000100:00100000:3.0:1788687833.020370:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+6:2345:x1875574819758336:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:3.0:1788687833.020411:0:5839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448dde 00000020:00010000:3.0:1788687833.020419:0:5839:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9af3c83c6800: total 0 00000100:00080000:3.0:1788687833.020424:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9af3c83c5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788687833.020458:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1788687833.020900:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9af3c83c6800: total 0 00010000:00010000:1.0:1788687833.020948:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9af3c83c6800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788687833.020983:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3ca87c600) 00010000:00010000:1.0:1788687833.020987:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788687833.020996:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f15d2000/0xc2ddd83e74449d0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462efb expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687833.021131:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9af3c83c6800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788687833.021144:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687833.021146:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687833.021148:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788687833.022251:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687833.023120:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e3c77f5-0083-4021-afe4-5890473fab59+3:2345:x1875574819758336:12345-192.168.204.26@tcp:39:umount.0 Request processed in 2745us (3018us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788687833.023134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 241 00000100:00100000:3.0:1788687833.047715:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687833.048191:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819758592 00000100:00100000:0.0:1788687833.048214:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819758592 00000100:00100000:0.0:1788687833.048277:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 303 00000100:00100000:0.0:1788687833.048288:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+7:2345:x1875574819758592:12345-192.168.204.26@tcp:251:umount.0 00000020:00000080:0.0:1788687833.048334:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448cd4 00000020:00010000:0.0:1788687833.048342:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9af3c83c4800: total 0 00000100:00080000:0.0:1788687833.048347:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9af3c83c2000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788687833.048437:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6+3:2345:x1875574819758592:12345-192.168.204.26@tcp:251:umount.0 Request processed in 151us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687833.048445:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 303 00000020:00010000:2.0:1788687833.049441:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9af3c83c4800: total 0 00010000:00010000:2.0:1788687833.049449:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687833.049529:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9af3c83c4800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788687833.049565:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d8c00/0xc2ddd83e74448d8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462a8d expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687833.049595:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9af3c83c4800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788687833.049606:0:5828:0:(genops.c:885:class_export_put()) final put ffff9af3c83c4800/eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6 00010000:00010000:2.0:1788687833.049623:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687833.049625:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687833.049627:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788687833.049676:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c83c4800/eb6da430-5e4b-48b8-b7fd-3c2dec7a5cf6 for MGS 00000020:00000080:1.0:1788687833.049727:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3c83c2000 for MGS 00000040:00080000:1.0:1788687833.541759:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788687833.541770:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687833.542196:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788687833.542204:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788687833.610184:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687834.181909:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839657600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788687834.182004:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687834.182150:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839657600 00000100:00100000:3.0:1788687834.182159:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839657600 00000100:00100000:3.0:1788687834.182232:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788687834.182243:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839657600:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788687834.182715:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788687834.182761:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687834.182816:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839657600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 576us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687834.182832:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788687834.182893:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839657600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687834.183293:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839657728:0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.183331:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687834.183466:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839658240:0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.183524:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687834.183554:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788687834.183561:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839658112:0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.183642:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687834.183669:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839657856:0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.183694:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687834.183715:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788687834.183721:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839657984:0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.183809:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687834.183848:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839658240 00000100:00100000:0.0:1788687834.183855:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839658240 00000100:00100000:0.0:1788687834.183899:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788687834.183907:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839658240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.183949:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839658240:12345-0@lo:400:kworker.0 Request processed in 43us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687834.183956:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788687834.183975:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839658112 00000100:00100000:0.0:1788687834.183978:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839658112 00000100:00100000:0.0:1788687834.184002:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839657856 00000100:00100000:0.0:1788687834.184005:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839657856 00000100:00100000:0.0:1788687834.184016:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839657984 00000100:00100000:0.0:1788687834.184018:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839657984 00000100:00100000:0.0:1788687834.184032:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788687834.184039:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839658112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.184068:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839658112:12345-0@lo:400:kworker.0 Request processed in 30us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687834.184074:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788687834.184085:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788687834.184090:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839657856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.184129:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875574839657856:12345-0@lo:400:kworker.0 Request processed in 39us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687834.184135:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788687834.184147:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788687834.184152:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839657984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687834.186915:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839657728 00000100:00100000:3.0:1788687834.186931:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839657728 00000100:00100000:3.0:1788687834.186997:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788687834.187007:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d01c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839657728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687834.187096:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d01c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3313:x1875574839657728:12345-0@lo:400:kworker.0 Request processed in 91us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687834.187103:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:3.0:1788687834.187151:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788687834.187157:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788687834.188427:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875574839657984:12345-0@lo:400:kworker.0 Request processed in 4266us (4609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687834.188438:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788687834.188661:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875574839657984:0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.188675:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875574839657856:0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.188716:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839658112:0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.188726:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3313:1875574839657728:0@lo:400:kworker.0 00000100:00100000:0.0:1788687834.188737:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839658240:0@lo:400:kworker.0 00000001:00100000:0.0:1788687834.260364:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:0.0:1788687834.260376:0:6712:0:(genops.c:885:class_export_put()) final put ffff9af3fc394800/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:3.0:1788687834.260598:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3fc394800/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f for lustre-OST0000 00000020:00000080:3.0:1788687834.260641:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3fc391000 for lustre-OST0000 00010000:00010000:1.0:1788687834.635104:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687834.695205:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839658368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687834.695291:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687834.695540:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839658368 00000100:00100000:0.0:1788687834.695552:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839658368 00000100:00100000:0.0:1788687834.695760:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788687834.695772:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839658368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788687834.695809:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687834.695867:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839658368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687834.695874:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788687834.695983:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839658368:0@lo:13:osp-pre-1-0.0 00000020:01000004:0.0:1788687834.857092:0:13069:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788687834.883856:0:13069:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788687834.883911:0:13069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687834.883926:0:13069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687834.883932:0:13069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687834.883939:0:13069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687834.883997:0:13069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788687834.884003:0:13069:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788687834.884039:0:13069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788687834.884044:0:13069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788687834.884050:0:13069:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788687834.884079:0:13069:0:(import.c:65:import_set_state_nolock()) ffff9af3fcd78000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788687834.884362:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb82ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875574839658496:0@lo:39:umount.0 00000100:00100000:1.0:1788687834.884441:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687834.884616:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839658496 00000100:00100000:3.0:1788687834.884625:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839658496 00000100:00100000:3.0:1788687834.884693:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788687834.884704:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875574839658496:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788687834.884733:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448ae3 00000100:00080000:3.0:1788687834.884742:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9af3f340a000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788687834.885020:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687834.885029:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.885039:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c1536000 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687834.885043:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.885053:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687834.885060:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687834.885065:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788687834.885068:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788687834.885078:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788687834.885114:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.885121:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687834.885151:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.885158:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c1536000/0xc2ddd83e74448d59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448d60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.885180:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687834.885182:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687834.885184:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687834.885191:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687834.885202:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839658624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788687834.885238:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687834.885652:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1875574839658496:12345-0@lo:39:umount.0 Request processed in 948us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687834.885671:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788687834.885684:0:5841:0:(genops.c:885:class_export_put()) final put ffff9af3f3408800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1788687834.885718:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839658624 00000100:00100000:3.0:1788687834.885723:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839658624 00000100:00100000:3.0:1788687834.885759:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788687834.885767:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+19:3310:x1875574839658624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687834.885793:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687834.885810:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ecc00/0xc2ddd83e74448d60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448d59 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.885825:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687834.885855:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:3310:x1875574839658624:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687834.885863:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788687834.885905:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839658624:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788687834.886175:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3fcd78000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788687834.886195:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb82ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875574839658496:0@lo:39:umount.0 00000020:00000080:2.0:1788687834.886296:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f3408800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788687834.886361:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3f340a000 for lustre-MDT0000 00000100:00080000:3.0:1788687834.887615:0:13069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788687834.887623:0:13069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788687834.887631:0:13069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788687834.888556:0:13069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.888571:0:13069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.888579:0:13069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.888586:0:13069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687834.888857:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687834.888866:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687834.888875:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c1536200 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:1.0:1788687834.888878:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687834.888888:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788687834.888895:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687834.888901:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788687834.888903:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788687834.888941:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687834.888947:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788687834.888987:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687834.888997:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687834.888999:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687834.889001:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687834.889080:0:13069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788687834.889086:0:13069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c1536200/0xc2ddd83e74448d67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448d6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.889104:0:13069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.889126:0:13069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.889132:0:13069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.889138:0:13069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687834.889223:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839658752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788687834.889291:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687834.889354:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839658752 00000100:00100000:2.0:1788687834.889361:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839658752 00000100:00100000:2.0:1788687834.889409:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788687834.889418:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+18:3312:x1875574839658752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788687834.889431:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687834.889448:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c13ede00/0xc2ddd83e74448d6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448d67 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.889461:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687834.889520:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:3312:x1875574839658752:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687834.889528:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788687834.889568:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839658752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687834.890044:0:13069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687834.890055:0:13069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.890064:0:13069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.890070:0:13069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.890077:0:13069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890174:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788687834.890180:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890187:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aace00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687834.890191:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890198:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687834.890204:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687834.890210:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788687834.890213:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788687834.890215:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788687834.890255:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890262:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687834.890288:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890294:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aace00/0xc2ddd83e74448c8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890319:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687834.890322:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890328:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aaca00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687834.890331:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890338:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687834.890344:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687834.890350:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788687834.890352:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788687834.890363:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890368:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687834.890383:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890391:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687834.890392:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687834.890394:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687834.890406:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839659008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788687834.890442:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687834.890504:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839659008 00000100:00100000:2.0:1788687834.890515:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839659008 00000100:00100000:2.0:1788687834.890546:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788687834.890553:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+17:3310:x1875574839659008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788687834.890562:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687834.890571:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f79ec800/0xc2ddd83e74448f89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448f82 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890582:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687834.890612:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:3310:x1875574839659008:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687834.890619:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788687834.890674:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3310:1875574839659008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788687834.890691:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788687834.890697:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839658880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788687834.890719:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687834.890741:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839658880 00000100:00100000:2.0:1788687834.890744:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839658880 00000100:00100000:2.0:1788687834.890767:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788687834.890774:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+16:3312:x1875574839658880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788687834.890780:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687834.890788:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c0031800/0xc2ddd83e74448c95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448c8e expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.890800:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687834.890826:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:3312:x1875574839658880:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687834.890834:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788687834.890858:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839658880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788687834.892548:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687834.892838:0:13069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788687834.892849:0:13069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aaca00/0xc2ddd83e74448f82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448f89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687834.892866:0:13069:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788687834.892935:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687834.892950:0:13069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.892959:0:13069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.892967:0:13069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.892973:0:13069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687834.893099:0:13069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788687834.893104:0:13069:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788687834.893107:0:13069:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788687834.893147:0:13069:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788687834.893151:0:13069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788687834.893155:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788687834.893170:0:13069:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1788687834.893176:0:13069:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9af3fbbfb000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788687834.893181:0:13069:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9af3f589a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788687834.893188:0:13069:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9af3c83c6800 2e3c77f5-0083-4021-afe4-5890473fab59 192.168.204.26@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788687834.893192:0:13069:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9af3c83c1000 bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 192.168.204.26@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:2.0:1788687834.893197:0:13069:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9af3f40d4d40) has exports, disconnecting them 00000020:00080000:2.0:1788687834.893201:0:13069:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9af3fbbfb000), last request at 1788687834 00000020:00000080:2.0:1788687834.893208:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448c56 00000100:00080000:2.0:1788687834.893226:0:13069:0:(import.c:65:import_set_state_nolock()) ffff9af3fbbfa000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788687834.893268:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687834.893275:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687834.893281:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9200 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:1.0:1788687834.893291:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687834.893299:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788687834.893307:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687834.893312:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788687834.893315:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788687834.893316:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788687834.893349:0:5828:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687834.893356:0:5828:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788687834.893394:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687834.893402:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af4021d9200/0xc2ddd83e74448a42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448a49 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687834.893417:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687834.893418:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687834.893420:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687834.893465:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839659136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687834.893571:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687834.893629:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839659136 00000100:00100000:3.0:1788687834.893648:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839659136 00000100:00100000:3.0:1788687834.893816:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788687834.893825:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+15:3311:x1875574839659136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687834.893841:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687834.893855:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c0031c00/0xc2ddd83e74448a49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448a42 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687834.893872:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687834.893906:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06ee7184-cb77-4c4b-8fd0-7ddc21a66059+14:3311:x1875574839659136:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687834.893912:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788687834.893948:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839659136:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788687834.894275:0:13069:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9af3fbbfb000): rc 0 00000020:00000080:2.0:1788687834.894278:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3fbbfb000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788687834.894299:0:13069:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9af3f589a000), last request at 1788687834 00000020:00000080:2.0:1788687834.894304:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448b8b 00000100:00080000:2.0:1788687834.894312:0:13069:0:(import.c:65:import_set_state_nolock()) ffff9af3f589b000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788687834.894344:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3fbbfb000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788687834.894393:0:12639:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3fbbfa000 for lustre-MDT0000 00010000:00010000:0.0:1788687834.894451:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788687834.894756:0:13069:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9af3f589a000): rc 0 00000020:00000080:2.0:1788687834.894759:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3f589a000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788687834.894801:0:13069:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9c602d4bae0 00000100:00080000:2.0:1788687834.894823:0:13069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788687834.894827:0:13069:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788687834.894847:0:13069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788687834.894908:0:13069:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788687834.894924:0:13069:0:(import.c:65:import_set_state_nolock()) ffff9af3f343a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788687834.894937:0:13069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788687834.894939:0:13069:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788687834.894946:0:13069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788687834.895000:0:13069:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788687834.895008:0:13069:0:(import.c:65:import_set_state_nolock()) ffff9af3c3152000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788687834.895124:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839659264:0@lo:9:umount.0 00000100:00100000:0.0:1788687834.895184:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687834.895213:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839659392:0@lo:9:umount.0 00000100:00100000:0.0:1788687834.895235:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687834.895270:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839659264 00000100:00100000:0.0:1788687834.895285:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839659264 00000100:00100000:0.0:1788687834.895318:0:8309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839659392 00000100:00100000:0.0:1788687834.895320:0:8309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839659392 00000100:00100000:0.0:1788687834.895337:0:8309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788687834.895344:0:8309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875574839659264:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788687834.895363:0:8309:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448bd8 00000100:00080000:0.0:1788687834.895370:0:8309:0:(import.c:65:import_set_state_nolock()) ffff9af3f343e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788687834.895414:0:13069:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9af3f40d4d40) has no exports 00010000:00010000:1.0:1788687834.895826:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788687834.895888:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f589a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788687834.895934:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3f589b000 for lustre-MDT0000 00000100:00100000:3.0:1788687834.895950:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788687834.895959:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875574839659392:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788687834.895973:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448cbf 00000100:00080000:3.0:1788687834.895979:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9af3c3157000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788687834.896118:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788687834.896346:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3309:x1875574839659392:12345-0@lo:9:umount.0 Request processed in 388us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687834.896354:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788687834.896395:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3c3152000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788687834.896405:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788687834.896407:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788687834.896419:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839659392:0@lo:9:umount.0 00010000:00010000:2.0:1788687834.896629:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788687834.896836:0:8309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788687834.897190:0:8309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3309:x1875574839659264:12345-0@lo:9:umount.0 Request processed in 1845us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687834.897199:0:8309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788687834.897278:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f343a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788687834.897296:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788687834.897298:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788687834.897301:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839659264:0@lo:9:umount.0 00010000:00010000:1.0:1788687834.897342:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788687834.907475:0:13069:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9af3f40d4d40) has no exports 00000020:00000080:3.0:1788687834.958067:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448a9d 00000020:00000080:3.0:1788687834.958086:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3ee73e000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788687834.958158:0:13069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788687834.958277:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788687834.958289:0:13069:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788687834.958293:0:13069:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9af3c5b4b380) has no exports 00000020:00000080:2.0:1788687834.958580:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448a96 00000020:00000080:2.0:1788687834.958589:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3fcd7b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788687834.958771:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3ee73e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788687834.960302:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3fcd7b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788687834.960391:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788687834.960401:0:13069:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788687834.960406:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3ed5a0800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788687834.960409:0:13069:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3ed5a0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788687834.960419:0:13069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00080000:3.0:1788687835.242776:0:12733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1788687835.243323:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e3c77f5-0083-4021-afe4-5890473fab59 00000001:00080000:3.0:1788687835.243331:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788687835.243335:0:5861:0:(genops.c:885:class_export_put()) final put ffff9af3c83c6800/2e3c77f5-0083-4021-afe4-5890473fab59 00000001:00100000:3.0:1788687835.243384:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000001:00080000:3.0:1788687835.243390:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788687835.243393:0:5861:0:(genops.c:885:class_export_put()) final put ffff9af3c83c1000/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:1.0:1788687835.243419:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c83c6800/2e3c77f5-0083-4021-afe4-5890473fab59 for lustre-MDT0000 00000020:00000080:1.0:1788687835.243525:0:12639:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3c83c5800 for lustre-MDT0000 00000020:00000080:1.0:1788687835.243727:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c83c1000/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f for lustre-MDT0000 00000020:00000080:1.0:1788687835.243765:0:12639:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3fbbfd800 for lustre-MDT0000 00010000:00010000:2.0:1788687835.654193:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788687835.758035:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788687835.758046:0:7643:0:(genops.c:885:class_export_put()) final put ffff9af3c3152800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788687835.758070:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:3.0:1788687835.758073:0:7643:0:(genops.c:885:class_export_put()) final put ffff9af3d2b02800/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f 00000020:00000080:2.0:1788687835.758237:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c3152800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788687835.758364:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3d2b02800/bc9cfac8-a60f-4f4b-94a2-cfcf1bae5e0f for lustre-OST0001 00000020:00000080:2.0:1788687835.758405:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3c3157000 for lustre-OST0001 00000020:00000080:2.0:1788687835.758415:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3c882f800 for lustre-OST0001 00010000:00010000:1.0:1788687836.678091:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788687836.998312:0:13069:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9af3ee9c0540 - data ffff9af3f8bc2438/ffff9af3f797fc00 00000020:01000000:2.0:1788687836.998452:0:13069:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9af3f14dacc0 - data ffff9af3f8b8ad80/ffff9af3fcbb4c00 00000001:00000004:2.0:1788687837.007163:0:13069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788687837.139334:0:13069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788687837.139343:0:13069:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788687837.139358:0:13069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788687837.139360:0:13069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788687837.140325:0:7076:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788687837.140331:0:7076:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788687837.140341:0:7076:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788687837.143444:0:13069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788687837.144931:0:13069:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788687837.145226:0:13069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788687837.145238:0:13069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788687837.145845:0:8140:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788687837.145851:0:8140:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788687837.145862:0:8140:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788687837.210690:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448a65 00000020:00000080:1.0:1788687837.210704:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3f40e7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788687837.211138:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f40e7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788687837.213361:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448a7a 00000020:00000080:1.0:1788687837.213377:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3f40e5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788687837.213444:0:13069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788687837.213451:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788687837.213460:0:13069:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788687837.213464:0:13069:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9af3f40d0000) has no exports 00000004:01000000:1.0:1788687837.213694:0:13069:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788687837.213704:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448cb8 00000020:00000080:1.0:1788687837.213709:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3f7b74800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788687837.213885:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f40e5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788687837.213958:0:13069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788687837.213964:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788687837.213971:0:13069:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788687837.213974:0:13069:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9af3f38bcd40) has no exports 00000020:00000080:1.0:1788687837.213981:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448cb1 00000020:00000080:1.0:1788687837.213985:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3f7b71800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788687837.214002:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f7b74800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788687837.214462:0:13069:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788687837.214497:0:13069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788687837.214502:0:13069:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788687837.214508:0:13069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788687837.214510:0:13069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788687837.214743:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f7b71800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788687837.214911:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788687837.214927:0:13069:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788687837.214936:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448bd1 00000020:00000080:1.0:1788687837.214942:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3ed4ca000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788687837.214982:0:12639:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3c3152000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788687837.214989:0:12639:0:(genops.c:885:class_export_put()) final put ffff9af3f7b72000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788687837.214992:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f7b72000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788687837.214997:0:12639:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788687837.215140:0:13069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788687837.215145:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788687837.215152:0:13069:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788687837.215155:0:13069:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9af3c2eb99c0) has no exports 00000020:00000080:1.0:1788687837.215160:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448bca 00000020:00000080:1.0:1788687837.215164:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3f343c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788687837.215186:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3ed4ca000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788687837.215721:0:13069:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788687837.215726:0:13069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788687837.215729:0:13069:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788687837.215734:0:13069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788687837.215735:0:13069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788687837.216004:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f343c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788687837.216136:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788687837.216143:0:13069:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788687837.216173:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788687837.216176:0:13069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788687837.216179:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3f343a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788687837.216182:0:13069:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f343a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788687837.216186:0:13069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788687837.216345:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448a81 00000020:00000080:1.0:1788687837.216352:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3f40e4000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788687837.221519:0:12639:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3f343a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788687837.221540:0:12639:0:(genops.c:885:class_export_put()) final put ffff9af3ed4cb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788687837.221544:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3ed4cb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788687837.221560:0:12639:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788687837.223080:0:13069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788687837.223093:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788687837.223104:0:13069:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788687837.223109:0:13069:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9af3f40d3380) has no exports 00000020:00000080:1.0:1788687837.223151:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788687837.223157:0:13069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788687837.223163:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448a88 00000020:00000080:1.0:1788687837.223170:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3f40e3800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788687837.223179:0:13069:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af3e6e77800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788687837.223182:0:13069:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3e6e77800 3 00000020:01000004:1.0:1788687837.223185:0:13069:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9af3e6e77800 from lustre-MDT0000 00000020:00000080:1.0:1788687837.223205:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788687837.223220:0:13069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788687837.223223:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3f40e1800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788687837.223226:0:13069:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f40e1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788687837.223302:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f40e4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788687837.223307:0:37:0:(genops.c:885:class_export_put()) final put ffff9af3f40e0000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788687837.223309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f40e0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788687837.223315:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788687837.223600:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f40e3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788687837.223707:0:13069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788687837.223742:0:13069:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788687837.223746:0:13069:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788687837.223749:0:13069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788687837.223752:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788687837.223755:0:13069:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788687837.223762:0:13069:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9af3c729a000 06ee7184-cb77-4c4b-8fd0-7ddc21a66059 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788687837.223768:0:13069:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9af3c2ebcd40) has exports, disconnecting them 00000020:00080000:1.0:1788687837.223773:0:13069:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9af3c729a000), last request at 1788687612 00000020:00000080:1.0:1788687837.223789:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448a26 00000020:00010000:1.0:1788687837.223794:0:13069:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9af3c729a000: total 0 00000100:00080000:1.0:1788687837.223798:0:13069:0:(import.c:65:import_set_state_nolock()) ffff9af3c729f000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788687837.223811:0:13069:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9af3c729a000): rc 0 00000020:00080000:1.0:1788687837.223815:0:13069:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9af3c2ebcd40) has no exports 00000100:00100000:0.0:1788687837.223902:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9af3c680ec00:5831] 0 exiting: rc = 1 00000020:00010000:2.0:1788687837.224056:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9af3c729a000: total 0 00010000:00010000:2.0:1788687837.224085:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9af3c729a000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788687837.224124:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38cd200/0xc2ddd83e74448f6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448f66 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687837.224142:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aac400/0xc2ddd83e74448d7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448d75 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687837.224153:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38cc800/0xc2ddd83e74448f7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448f74 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687837.224167:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d9600/0xc2ddd83e74448b3e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448b37 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687837.224193:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aac200/0xc2ddd83e74448d36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448d2f expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687837.224203:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c1537600/0xc2ddd83e74448d28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448d21 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687837.224214:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4021d8800/0xc2ddd83e74448d44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448d3d expref: 3 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687837.224223:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3c1536a00/0xc2ddd83e74448d52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2ddd83e74448d4b expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687837.224233:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9af3c729a000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788687837.224247:0:5827:0:(genops.c:885:class_export_put()) final put ffff9af3c729a000/06ee7184-cb77-4c4b-8fd0-7ddc21a66059 00010000:00010000:2.0:1788687837.224267:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687837.224269:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687837.224271:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687837.224582:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9af3c680e800:5833] 1 exiting: rc = 0 00000020:00000080:0.0:1788687837.224709:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c729a000/06ee7184-cb77-4c4b-8fd0-7ddc21a66059 for MGS 00000020:00000080:0.0:1788687837.224741:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3c729f000 for MGS 00000100:00100000:0.0:1788687837.225750:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9af3c680ee00:5834] 2 exiting: rc = 0 00000100:00100000:1.0:1788687837.227424:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227434:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227442:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227448:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227459:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227476:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227498:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227505:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227510:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227517:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227522:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227527:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227534:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227539:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227544:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227564:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227571:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227576:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227582:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227590:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227596:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227602:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227608:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227613:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227816:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227822:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227829:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227834:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227840:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227844:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227850:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227855:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227860:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227865:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227870:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227875:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227879:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227884:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227888:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227893:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227900:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227905:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227910:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227915:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227920:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227924:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227929:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227934:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227939:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227944:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227957:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227963:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227968:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227973:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227978:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227984:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227989:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.227995:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.228000:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.228006:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.228011:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.228019:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.228024:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.228029:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788687837.228829:0:13069:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788687837.228834:0:13069:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788687837.231394:0:13069:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9af3c552f420 - data ffff9af3d68a11b0/ffff9af3f7a90400 00000020:01000000:2.0:1788687837.231572:0:13069:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9af3e6ef52a0 - data ffff9af3f8af7438/ffff9af3c5b9a000 00000020:00000080:2.0:1788687837.235014:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448a0a 00000020:00000080:2.0:1788687837.235027:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3c6a19000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788687837.235161:0:13069:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af3e6e77800 from MGS, refs=2 00000020:01000004:2.0:1788687837.235165:0:13069:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3e6e77800 2 00000020:01000004:2.0:1788687837.235168:0:13069:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9af3e6e77800 from MGS 00000020:00000080:2.0:1788687837.235222:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788687837.235230:0:13069:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788687837.235233:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3c6a1b000/MGS 00000020:00000080:2.0:1788687837.235236:0:13069:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c6a1b000/MGS for MGS 00000020:01000000:2.0:1788687837.235270:0:13069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788687837.235378:0:13069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788687837.235383:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788687837.235389:0:13069:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788687837.235415:0:13069:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9af3c5a61800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788687837.235421:0:13069:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9af3c5b499c0) has exports, disconnecting them 00000020:00080000:2.0:1788687837.235940:0:13069:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9af3c5a61800), last request at 1788687613 00000020:00000080:2.0:1788687837.235946:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448ad5 00000020:00080000:2.0:1788687837.235959:0:13069:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9af3c5a61800): rc 0 00000020:00000080:2.0:1788687837.235964:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3c5a61800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788687837.236219:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c6a19000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788687837.239705:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c5a61800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788687837.241841:0:13069:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788687837.241850:0:13069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788687837.241854:0:13069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788687837.241863:0:13069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788687837.242160:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788687837.242171:0:13069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788687837.242177:0:13069:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3e6e77800 1 00000020:00000080:0.0:1788687837.242185:0:13069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e744489fc 00000020:00000080:0.0:1788687837.242194:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3c6a1f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788687837.242275:0:12639:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3fcd78000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788687837.242293:0:12639:0:(genops.c:885:class_export_put()) final put ffff9af3fcd7c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788687837.242297:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3fcd7c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788687837.242306:0:12639:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1788687837.242507:0:13069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788687837.242514:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788687837.242519:0:13069:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788687837.242523:0:13069:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9af3c5b48000) has no exports 00000020:00000080:1.0:1788687837.242720:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c6a1f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788687837.300866:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788687837.300884:0:13069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788687837.300891:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3e6e70000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788687837.300896:0:13069:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3e6e70000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788687837.300903:0:13069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788687837.301035:0:13069:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9af3e6e73000 00000020:01000000:1.0:1788687837.301056:0:13069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788687837.301060:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788687837.301064:0:13069:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788687837.301069:0:13069:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9af3c5b4cd40) has no exports 00000100:00100000:3.0:1788687837.308052:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9af3c30b2600:5841] 2 exiting: rc = 0 00000100:00100000:0.0:1788687837.308052:0:8462:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9af3f3efac00:8462] 3 exiting: rc = 0 00000100:00100000:0.0:1788687837.308250:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9af3c687be00:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1788687837.308322:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9af3c30b2a00:5839] 0 exiting: rc = 1 00000100:00100000:1.0:1788687837.308761:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308784:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308793:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308801:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308809:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308815:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308823:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308830:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308838:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308847:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308855:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308862:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308870:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308880:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308893:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308904:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308911:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308940:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308948:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308955:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308960:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308966:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308972:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308978:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308984:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308989:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.308996:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309002:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309008:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309014:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309020:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309026:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309032:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309038:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309044:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309050:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309066:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309072:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309079:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309084:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309090:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309095:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309100:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309105:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309111:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309126:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309133:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309139:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309144:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309150:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309156:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309162:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309169:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309175:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309181:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309187:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309193:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309199:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309205:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309211:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309216:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309222:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309229:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.309244:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.314133:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9af3c30b3600:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1788687837.314230:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9af3c687ba00:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1788687837.314728:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314737:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314743:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314750:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314769:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314776:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314782:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314789:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314795:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314802:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314808:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314815:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314823:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314828:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314833:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314838:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314843:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314847:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314853:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314858:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314863:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314868:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314873:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314879:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314899:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314904:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314909:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314914:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314920:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314925:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314931:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314936:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314941:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314946:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314951:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314956:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314960:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314966:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314970:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314983:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314989:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314994:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.314999:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315004:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315011:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315017:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315023:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315028:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315034:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315039:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315045:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315050:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315054:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315059:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315064:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315069:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315074:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315080:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315085:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315091:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315095:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315100:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315105:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.315111:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.319080:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9af3c681f600:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1788687837.319193:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9af3c824d400:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1788687837.319434:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.319443:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.319450:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.319455:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.319471:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320072:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320080:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320087:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320093:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320099:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320105:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320111:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320130:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320136:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320143:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320149:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320174:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320182:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320188:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320193:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320199:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320204:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320210:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320215:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320221:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320226:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320231:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320236:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320254:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320260:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320265:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320270:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320276:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320282:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320288:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320293:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320299:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320304:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320310:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320316:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320344:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320350:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320356:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320363:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320369:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320375:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320381:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320387:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320393:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320400:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320406:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320413:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320434:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320441:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320448:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320454:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320460:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320466:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.320472:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.321300:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.321321:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.321330:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.321341:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.321354:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.333808:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9af3c824c800:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1788687837.333924:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9af3c681fc00:5847] 1 exiting: rc = 0 00000100:00100000:0.0:1788687837.334012:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334020:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334025:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334030:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334038:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334043:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334048:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334052:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334058:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334075:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334080:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334085:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334090:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334095:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334100:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334105:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334110:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334129:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334136:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334141:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334146:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334151:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334156:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334161:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334166:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334171:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334176:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334180:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334185:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334189:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334194:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334198:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334203:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334208:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334213:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334218:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334223:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334228:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334232:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334237:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334241:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334247:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334252:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334258:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334281:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334286:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334291:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334296:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334301:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334306:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334312:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334317:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334322:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334327:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334331:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334336:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334340:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334345:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334350:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334354:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334359:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334364:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334368:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.334373:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335006:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9af3c5b2d200:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1788687837.335019:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9af3c5b2dc00:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1788687837.335081:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335087:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335093:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335098:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335103:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335107:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335123:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335129:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335134:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335139:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335145:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335150:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335155:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335160:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335173:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335178:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335183:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335188:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335193:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335198:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335203:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335208:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335213:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335217:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335221:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335226:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335231:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335235:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335240:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335245:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335250:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.335255:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336303:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336323:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336330:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336336:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336340:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336345:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336350:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336355:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336360:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336365:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336371:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336376:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336381:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336386:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336392:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336396:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336400:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336416:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336421:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336425:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336430:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336435:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336439:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336444:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336449:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336454:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336459:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336464:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336468:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336472:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336477:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.336499:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.339000:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9af3c5b2da00:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1788687837.339572:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9af3c5b2c400:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1788687837.339954:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340101:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340108:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340124:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340130:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340135:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340140:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340145:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340152:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340157:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340161:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340167:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340172:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340176:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340181:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340185:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340190:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340193:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340199:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340204:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340222:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340227:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340231:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340236:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340241:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340245:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340250:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340255:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340259:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340346:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340353:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340359:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340365:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340371:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340378:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340383:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340391:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340396:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340402:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.340408:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341012:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341022:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341027:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341032:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341037:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341041:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341046:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341052:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341057:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341061:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341066:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341071:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341076:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341080:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341086:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341099:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341104:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341109:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341124:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341129:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341134:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341139:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341143:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687837.341148:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687837.342180:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9af3c5b26600:5852] 0 exiting: rc = 1 00000100:00100000:1.0:1788687837.342595:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9af3c5b2d600:5854] 2 exiting: rc = 0 00000100:00100000:2.0:1788687837.345512:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9af3c5b27800:5853] 1 exiting: rc = 0 00000100:00100000:2.0:1788687837.345890:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345898:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345904:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345909:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345914:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345920:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345925:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345930:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345935:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345940:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345945:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345950:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345955:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345959:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345976:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345980:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.345985:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346009:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346014:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346020:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346025:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346030:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346035:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346040:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346045:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346050:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346055:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346059:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346064:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346069:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346074:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346080:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346085:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346090:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346096:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346102:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346107:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346123:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346129:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346134:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346139:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346156:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346162:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346167:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346172:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346177:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346182:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346187:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346192:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346201:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346208:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346213:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346218:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346223:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346228:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346235:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346240:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346245:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346250:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346255:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346260:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346266:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.346272:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687837.347448:0:13069:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788687837.356573:0:13069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788687837.356770:0:13069:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788687837.356776:0:13069:0:(genops.c:885:class_export_put()) final put ffff9af3e0255800/MDS_uuid 00000020:00000080:2.0:1788687837.356781:0:13069:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3e0255800/MDS_uuid for MDS 00000020:01000000:2.0:1788687837.356788:0:13069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788687837.356904:0:13069:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788687837.702134:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687838.726815:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687839.311094:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839659520:0@lo:400:kworker.0 00000400:00000100:2.0:1788687839.311153:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875574839659520 offset 0 length 224: 4 00000100:00100000:2.0:1788687839.311203:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788687839.311211:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839659648:0@lo:400:kworker.0 00000400:00000100:2.0:1788687839.311231:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875574839659648 offset 0 length 224: 4 00000100:00100000:0.0:1788687839.312221:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839659776:0@lo:400:kworker.0 00000400:00000100:0.0:1788687839.312255:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875574839659776 offset 0 length 224: 4 00000001:00100000:3.0:1788687839.346967:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788687839.346977:0:6712:0:(genops.c:885:class_export_put()) final put ffff9af3f3438000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788687839.347057:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f3438000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788687839.347121:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3f343e800 for lustre-OST0000 00010000:00010000:0.0:1788687839.751429:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788687840.125071:0:13226:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788687840.153858:0:13226:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788687840.153911:0:13226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687840.153946:0:13226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687840.153954:0:13226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687840.153961:0:13226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687840.153994:0:13226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788687840.154000:0:13226:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788687840.154020:0:13226:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788687840.154032:0:13226:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9af3ffe38a80 x1875574839659648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687855 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687840.154057:0:13226:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788687840.154072:0:13226:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788687840.154099:0:13226:0:(import.c:65:import_set_state_nolock()) ffff9af3f7b75000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788687840.154180:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839659648:0@lo:400:kworker.0 00000100:00100000:3.0:1788687840.154216:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875574839659904:0@lo:39:umount.0 00000400:00000100:3.0:1788687840.154263:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875574839659904 offset 0 length 224: 4 00010000:00010000:0.0:1788687840.154463:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687840.154471:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687840.154707:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aadc00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687840.154712:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687840.154722:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687840.154729:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687840.154736:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788687840.154738:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788687840.154741:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788687840.154773:0:5827:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687840.154794:0:5827:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788687840.154838:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839660032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687840.154885:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687840.154953:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839660032 00000100:00100000:2.0:1788687840.154961:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839660032 00000100:00100000:2.0:1788687840.155008:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788687840.155016:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c56d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1875574839660032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788687840.155022:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788687840 with bad export cookie 14041616975961295398 00010000:00010000:0.0:1788687840.156809:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687840.156824:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aadc00/0xc2ddd83e74448d3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc2ddd83e74448d44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687840.156841:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687840.156843:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687840.156846:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687840.173822:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c56d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1875574839660032:12345-0@lo:103:ldlm_bl.0 Request processed in 18795us (18926us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788687840.173837:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788687840.177907:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788687840.177915:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9af3c8345000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788687840.177920:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788687840.189513:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.126@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788687840.189521:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788687840.189532:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9af3ffe38e00 x1875574839659520/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788687855 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687840.189920:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9af3c697f100 x1875574839660032/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788687856 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788687840.189932:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788687840.189935:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788687840.189936:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788687840.189941:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9af3c8345000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788687840.189947:0:3311:0:(import.c:545:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 158 00000100:00080000:3.0:1788687840.189956:0:3311:0:(import.c:665:import_select_connection()) MGC192.168.204.126@tcp: import ffff9af3c8345000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788687840.190004:0:3311:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3fc1c4700 x1875574839660160/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788687840.190046:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3311:1875574839660032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687840.190134:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3309:1875574839660160:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788687840.190187:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875574839660160 offset 0 length 520: 4 00000100:00100000:2.0:1788687840.190938:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3312:1875574839659520:0@lo:400:kworker.0 00010000:00010000:0.0:1788687840.777682:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687841.800200:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687842.825289:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687843.845923:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788687844.421743:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788687844.421756:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788687844.421826:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839660288:0@lo:400:kworker.0 00000400:00000100:1.0:1788687844.421875:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875574839660288 offset 0 length 224: 4 00010000:00010000:0.0:1788687844.869704:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687845.894351:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687846.918627:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687847.941864:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687848.968100:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788687849.541742:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788687849.541752:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788687849.542006:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788687849.542031:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839660416:0@lo:400:kworker.0 00000400:00000100:3.0:1788687849.542088:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875574839660416 offset 0 length 224: 4 00010000:00010000:0.0:1788687849.989971:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687850.565588:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788687840/real 1788687840] req@ffff9af3fc1c4700 x1875574839660160/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788687850 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687850.565621:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9af3fc1c4700 x1875574839660160/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788687850 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687850.565654:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788687840/real 1788687840] req@ffff9af3ffe3ad80 x1875574839659904/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788687850 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687850.565668:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9af3ffe3ad80 x1875574839659904/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788687850 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788687850.565684:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3c8345000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788687850.565713:0:3309:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788687850.565717:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3309:1875574839660160:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1788687850.565724:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f7b75000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788687850.565743:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875574839659904:0@lo:39:umount.0 00000100:00080000:2.0:1788687850.565829:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788687850.565834:0:12639:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788687850.565837:0:12639:0:(import.c:65:import_set_state_nolock()) ffff9af3c8345000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788687850.565841:0:12639:0:(import.c:545:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 385 00000100:00080000:2.0:1788687850.565846:0:12639:0:(import.c:630:import_select_connection()) MGC192.168.204.126@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788687850.565852:0:12639:0:(import.c:665:import_select_connection()) MGC192.168.204.126@tcp: import ffff9af3c8345000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788687850.565893:0:12639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af2c2a80a80 x1875574839660544/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788687850.566046:0:13226:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788687850.566051:0:13226:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788687850.566055:0:13226:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788687850.567182:0:13226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687850.567198:0:13226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687850.567206:0:13226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687850.567213:0:13226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687850.567307:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788687850.567322:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839660672:0@lo:400:kworker.0 00000400:00000100:3.0:1788687850.567372:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875574839660672 offset 0 length 224: 4 00000100:00100000:3.0:1788687850.567430:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3309:1875574839660544:0@lo:250:kworker.0 00000400:00000100:3.0:1788687850.567451:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875574839660544 offset 0 length 520: 4 00010000:00010000:0.0:1788687850.567536:0:13226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788687850.567546:0:13226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687850.567553:0:13226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687850.567559:0:13226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687850.567565:0:13226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687850.568935:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788687850.568946:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687850.568957:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8000 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687850.568962:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687850.568972:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687850.568980:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687850.568986:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788687850.568988:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788687850.569000:0:5828:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9af3c8345000 00010000:00010000:2.0:1788687850.569004:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687850.569044:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af4021d8000/0xc2ddd83e74448d4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448d52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687850.569064:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687850.569068:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687850.569074:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2a00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687850.569077:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687850.569084:0:5828:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687850.569091:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687850.569096:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788687850.569099:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788687850.569104:0:5828:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9af3c8345000 00010000:00010000:2.0:1788687850.569107:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687850.569115:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687850.569117:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687850.569119:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687850.569582:0:13226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788687850.569589:0:13226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3f15d2a00/0xc2ddd83e74448f74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448f7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687850.569600:0:13226:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788687850.569614:0:13226:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788687850.569616:0:13226:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788687850.569646:0:13226:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788687850.569650:0:13226:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788687850.569656:0:13226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788687850.569662:0:13226:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788687850.569667:0:13226:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9af3e0233380) has no exports 00000020:00080000:0.0:1788687850.569694:0:13226:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9af3e0233380) has no exports 00010000:00010000:2.0:1788687850.570852:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788687850.574129:0:13226:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9af3f39d71e0 - data ffff9af3f8bc0000/ffff9af3f37bec00 00000020:01000000:0.0:1788687850.574595:0:13226:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9af3d0017c00 - data ffff9af2c14e9bd0/ffff9af3f7b8b400 00100000:10000000:0.0:1788687850.582408:0:13226:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788687850.622819:0:13226:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448b5a 00000020:00000080:1.0:1788687850.622830:0:13226:0:(genops.c:885:class_export_put()) final put ffff9af3f7b77000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788687850.622874:0:13226:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af3f39f5000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788687850.622879:0:13226:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3f39f5000 2 00000020:01000004:1.0:1788687850.622882:0:13226:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9af3f39f5000 from lustre-OST0000 00000020:00000080:1.0:1788687850.622909:0:13226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788687850.622919:0:13226:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788687850.622923:0:13226:0:(genops.c:885:class_export_put()) final put ffff9af3f7b74000/lustre-OST0000_UUID 00000020:00000080:1.0:1788687850.622926:0:13226:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f7b74000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788687850.622934:0:13226:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788687850.623005:0:13226:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788687850.623010:0:13226:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788687850.623014:0:13226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788687850.623019:0:13226:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788687850.623027:0:13226:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9af3ffb86800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788687850.623033:0:13226:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9af3e02319c0) has exports, disconnecting them 00000020:00080000:1.0:1788687850.623038:0:13226:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9af3ffb86800), last request at 1788687627 00000020:00000080:1.0:1788687850.623042:0:13226:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448b84 00000020:00080000:1.0:1788687850.623052:0:13226:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9af3ffb86800): rc 0 00000020:00000080:1.0:1788687850.623056:0:13226:0:(genops.c:885:class_export_put()) final put ffff9af3ffb86800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788687850.624049:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f7b77000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788687850.624062:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3ffb86800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788687850.643566:0:13226:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788687850.643578:0:13226:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788687850.643583:0:13226:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788687850.643591:0:13226:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788687850.643689:0:12639:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3f7b75000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788687850.643915:0:13226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788687850.643923:0:13226:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788687850.643929:0:13226:0:(genops.c:885:class_export_put()) final put ffff9af3f7b75800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788687850.643933:0:13226:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f7b75800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788687850.643941:0:13226:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788687850.644003:0:13226:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3f39f5000 1 00000020:00000080:3.0:1788687850.644010:0:13226:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448b14 00000020:00000080:3.0:1788687850.644030:0:13226:0:(genops.c:885:class_export_put()) final put ffff9af3ed4c8800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788687850.644046:0:13226:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788687850.644051:0:13226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788687850.644066:0:13226:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788687850.644070:0:13226:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9af3e0234d40) has no exports 00000020:00000080:2.0:1788687850.644139:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3ed4c8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788687850.686324:0:13226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788687850.686339:0:13226:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788687850.686345:0:13226:0:(genops.c:885:class_export_put()) final put ffff9af3f39f3800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788687850.686350:0:13226:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f39f3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788687850.686370:0:13226:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788687850.686658:0:13226:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9af3f39f2800 00000020:02000400:3.0:1788687850.686733:0:13226:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788687851.013742:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687852.038035:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687853.062302:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788687853.597299:0:13377:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788687853.617615:0:13377:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788687853.617719:0:13377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687853.617736:0:13377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687853.617743:0:13377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687853.617752:0:13377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687853.617776:0:13377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788687853.617782:0:13377:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788687853.617823:0:13377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788687853.617837:0:13377:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9af3ffe38380 x1875574839659776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687855 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687853.617873:0:13377:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9af3ffe3a680 x1875574839660288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687860 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687853.617893:0:13377:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9af3ffe3b100 x1875574839660416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687865 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687853.617922:0:13377:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9af2c2a83800 x1875574839660672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687866 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687853.617934:0:13377:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788687853.617944:0:13377:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788687853.617979:0:13377:0:(import.c:65:import_set_state_nolock()) ffff9af3f7b73800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788687853.618017:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875574839660800:0@lo:39:umount.0 00000100:00100000:1.0:1788687853.618028:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839660416:0@lo:400:kworker.0 00000100:00100000:1.0:1788687853.618041:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875574839660288:0@lo:400:kworker.0 00000400:00000100:3.0:1788687853.618073:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875574839660800 offset 0 length 224: 4 00000100:00100000:1.0:1788687853.618096:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839660672:0@lo:400:kworker.0 00010000:00010000:2.0:1788687853.618505:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687853.618516:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687853.618525:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3c13ec600 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687853.618530:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687853.618545:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687853.618546:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839659776:0@lo:400:kworker.0 10000000:00010000:2.0:1788687853.618560:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687853.618567:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788687853.618571:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788687853.618574:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788687853.618593:0:5827:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9af3c8345000 00010000:00010000:2.0:1788687853.618597:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687853.618616:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3c13ec600/0xc2ddd83e74448d21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448d28 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687853.618629:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687853.618632:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687853.618634:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687854.086435:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687855.109712:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788687855.685771:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788687855.685780:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788687856.133877:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687857.159192:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687858.181987:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687859.206545:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687860.230151:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788687860.806035:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788687860.806045:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788687861.253838:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687862.277686:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687863.302957:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687863.813764:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788687853/real 1788687853] req@ffff9af3fc1c4700 x1875574839660800/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788687863 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687863.813800:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9af3fc1c4700 x1875574839660800/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788687863 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788687863.813823:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f7b73800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788687863.813853:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875574839660800:0@lo:39:umount.0 00000100:00080000:1.0:1788687863.814092:0:13377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788687863.814097:0:13377:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788687863.814102:0:13377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788687863.815844:0:13377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687863.815875:0:13377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687863.815883:0:13377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687863.815890:0:13377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687863.815921:0:13377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788687863.815928:0:13377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687863.815935:0:13377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687863.815942:0:13377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687863.815949:0:13377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687863.815967:0:13377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788687863.815973:0:13377:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788687863.816907:0:13377:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788687863.816913:0:13377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788687863.816919:0:13377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788687863.816925:0:13377:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788687863.816930:0:13377:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9af3f40d19c0) has no exports 00000020:00080000:1.0:1788687863.816964:0:13377:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9af3f40d19c0) has no exports 00010000:00010000:0.0:1788687863.817936:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788687863.817947:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687863.817958:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8e00 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687863.817962:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687863.817973:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687863.817981:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687863.818136:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788687863.818152:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788687863.818154:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788687863.818173:0:5827:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9af3c8345000 00010000:00010000:0.0:1788687863.818183:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687863.818190:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af4021d8e00/0xc2ddd83e74448d2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448d36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687863.818205:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687863.818208:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687863.818214:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad200 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687863.818217:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687863.818223:0:5827:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687863.818229:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687863.818233:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788687863.818235:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788687863.818237:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788687863.818243:0:5827:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9af3c8345000 00010000:00010000:0.0:1788687863.818245:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687863.818250:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad200/0xc2ddd83e74448f66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448f6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687863.818269:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687863.818270:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687863.818272:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687863.818749:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788687863.830951:0:13377:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9af3f39d7d20 - data ffff9af3f7c5d000/ffff9af3f7b8b800 00000020:01000000:1.0:1788687863.831095:0:13377:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9af3c7287ba0 - data ffff9af2c14ea510/ffff9af3fb9aa000 00100000:10000000:3.0:1788687863.844148:0:13377:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788687863.899024:0:13377:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448c25 00000020:00000080:1.0:1788687863.899035:0:13377:0:(genops.c:885:class_export_put()) final put ffff9af3ffb85800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788687863.899051:0:13377:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af3ffb81000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788687863.899055:0:13377:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3ffb81000 2 00000020:01000004:1.0:1788687863.899058:0:13377:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9af3ffb81000 from lustre-OST0001 00000020:00000080:1.0:1788687863.899080:0:13377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788687863.899090:0:13377:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788687863.899093:0:13377:0:(genops.c:885:class_export_put()) final put ffff9af3f7b77800/lustre-OST0001_UUID 00000020:00000080:1.0:1788687863.899096:0:13377:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f7b77800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788687863.899111:0:13377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788687863.899255:0:13377:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 06ee7184-cb77-4c4b-8fd0-7ddc21a66059->MGS 00010000:00010000:1.0:1788687863.899270:0:13377:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad000/0xc2ddd83e74448b37 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448b3e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788687863.899281:0:13377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad000/0xc2ddd83e74448b37 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448b3e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687863.899288:0:13377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788687863.899291:0:13377:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788687863.899294:0:13377:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788687863.899308:0:13377:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9af3c8345000 00010000:00010000:1.0:1788687863.899311:0:13377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad000/0xc2ddd83e74448b37 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448b3e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687863.899326:0:13377:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af4021d9e00/0xc2ddd83e74448d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc2ddd83e74448d7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788687863.899333:0:13377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af4021d9e00/0xc2ddd83e74448d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc2ddd83e74448d7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687863.899348:0:13377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788687863.899351:0:13377:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788687863.899353:0:13377:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788687863.899362:0:13377:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9af3c8345000 00010000:00010000:1.0:1788687863.899365:0:13377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af4021d9e00/0xc2ddd83e74448d75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc2ddd83e74448d7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788687863.899381:0:13377:0:(import.c:65:import_set_state_nolock()) ffff9af3c8345000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788687863.899385:0:13377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788687863.899387:0:13377:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788687863.899388:0:13377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788687863.899392:0:13377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788687863.899403:0:13377:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9af2c2a80a80 x1875574839660544/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788687865 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788687863.899427:0:13377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788687863.899431:0:13377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:3.0:1788687863.899921:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3ffb85800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788687863.900034:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06ee7184-cb77-4c4b-8fd0-7ddc21a66059:3309:1875574839660544:0@lo:250:kworker.0 10000000:01000000:1.0:1788687863.900184:0:13377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788687863.900192:0:13377:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448a18 00000020:00000080:1.0:1788687863.900197:0:13377:0:(genops.c:885:class_export_put()) final put ffff9af3e0256800/06ee7184-cb77-4c4b-8fd0-7ddc21a66059 00000020:01000000:1.0:1788687863.900214:0:13377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.126@tcp (flags='') 00000020:00000080:1.0:1788687863.900219:0:13377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788687863.900224:0:13377:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.126@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788687863.900228:0:13377:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9af3e0230000) has no exports 00000020:00000080:3.0:1788687863.900271:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3e0256800/06ee7184-cb77-4c4b-8fd0-7ddc21a66059 for MGC192.168.204.126@tcp 10000000:01000000:2.0:1788687863.900310:0:5836:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788687863.900388:0:13377:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.126@tcp: client import never connected 00000100:00080000:1.0:1788687863.900391:0:13377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788687863.900393:0:13377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788687863.900395:0:13377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788687863.900397:0:13377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788687863.900437:0:13377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788687863.900442:0:13377:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.126@tcp (uuid 06ee7184-cb77-4c4b-8fd0-7ddc21a66059) 00000020:01000000:1.0:1788687863.900447:0:13377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788687863.900459:0:13377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788687863.900462:0:13377:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788687863.900467:0:13377:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9af3f7b76000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788687863.900472:0:13377:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9af3f38b8000) has exports, disconnecting them 00000020:00080000:1.0:1788687863.900475:0:13377:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9af3f7b76000), last request at 1788687645 00000020:00000080:1.0:1788687863.900504:0:13377:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448c4f 00000020:00080000:1.0:1788687863.900515:0:13377:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9af3f7b76000): rc 0 00000020:00000080:3.0:1788687863.900703:0:12639:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3c8345000 for MGC192.168.204.126@tcp 00000020:00000080:3.0:1788687863.900710:0:12639:0:(genops.c:885:class_export_put()) final put ffff9af3c8346800/06ee7184-cb77-4c4b-8fd0-7ddc21a66059 00000020:00000080:3.0:1788687863.900713:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c8346800/06ee7184-cb77-4c4b-8fd0-7ddc21a66059 for MGC192.168.204.126@tcp 00000020:01000000:3.0:1788687863.900717:0:12639:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.126@tcp (06ee7184-cb77-4c4b-8fd0-7ddc21a66059) 00000020:00000080:1.0:1788687863.901085:0:13377:0:(genops.c:885:class_export_put()) final put ffff9af3f7b76000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788687863.904201:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3f7b76000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788687863.904537:0:13377:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788687863.904542:0:13377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788687863.904564:0:13377:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788687863.904580:0:13377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788687863.905423:0:12639:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9af3f7b73800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788687863.906109:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788687863.907598:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788687863.907797:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9af3e2f2d800:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1788687863.952208:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9af3c5a01e00:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1788687863.952309:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.952698:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9af3c5a00c00:5826] 2 exiting: rc = 0 00000100:00100000:3.0:1788687863.952787:0:7632:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9af3eea34600:7632] 3 exiting: rc = 0 00000100:00100000:1.0:1788687863.953123:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9af3c5a01600:5825] 1 exiting: rc = 0 00000100:00100000:1.0:1788687863.971715:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9af3c5a01800:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1788687863.972042:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972055:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972063:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972070:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972076:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972083:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972090:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972097:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972103:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972112:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972118:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972124:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972130:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972140:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972145:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972152:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972157:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972163:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972169:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972174:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972179:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972193:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972199:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972205:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972211:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972218:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972223:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972229:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972259:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972264:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972270:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972276:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972283:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972289:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972295:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972300:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972305:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972311:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972316:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972322:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972338:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972345:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972350:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972356:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972362:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972367:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972372:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972378:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972384:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972389:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972395:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972401:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972407:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972412:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972417:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972423:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972429:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972434:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972439:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972444:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972450:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972456:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972460:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687863.972475:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788687863.973524:0:13377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788687863.973538:0:13377:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788687863.973546:0:13377:0:(genops.c:885:class_export_put()) final put ffff9af3c3154000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788687863.973552:0:13377:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3c3154000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788687863.973625:0:13377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788687863.973677:0:13377:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3ffb81000 1 00000020:00000080:3.0:1788687863.973685:0:13377:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2ddd83e74448bf4 00000020:00000080:3.0:1788687863.973693:0:13377:0:(genops.c:885:class_export_put()) final put ffff9af3ed4c9000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788687863.973889:0:13377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788687863.973896:0:13377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788687863.973901:0:13377:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788687863.973906:0:13377:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9af3c2eb8000) has no exports 00000020:00000080:1.0:1788687863.976938:0:12639:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3ed4c9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788687864.038054:0:13377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788687864.038077:0:13377:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788687864.038087:0:13377:0:(genops.c:885:class_export_put()) final put ffff9af3ffb83000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788687864.038093:0:13377:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3ffb83000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788687864.038111:0:13377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788687864.039029:0:13377:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9af3ffb82000 00000020:01000000:2.0:1788687864.039060:0:13377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788687864.039066:0:13377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788687864.039071:0:13377:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788687864.039076:0:13377:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9af3c2ebb380) has no exports 00000020:00000080:2.0:1788687864.039123:0:13377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788687864.039131:0:13377:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788687864.039135:0:13377:0:(genops.c:885:class_export_put()) final put ffff9af3ed4ce000/OSS_uuid 00000020:00000080:2.0:1788687864.039139:0:13377:0:(genops.c:844:class_export_destroy()) destroying export ffff9af3ed4ce000/OSS_uuid for OSS 00000020:01000000:2.0:1788687864.039145:0:13377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788687864.039373:0:5835:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788687864.040069:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9af3fc1fa200:6686] 0 exiting: rc = 1 00000100:00100000:2.0:1788687864.042077:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9af3c841ec00:6687] 1 exiting: rc = 0 00000100:00100000:2.0:1788687864.042176:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9af3c841e800:6689] 2 exiting: rc = 0 00000100:00100000:2.0:1788687864.042231:0:8309:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9af3f3be5c00:8309] 3 exiting: rc = 0 00000100:00100000:3.0:1788687864.042322:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042331:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042339:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042347:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042358:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042364:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042370:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042376:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042382:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042387:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042393:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042401:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042407:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042413:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042418:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042423:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042428:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042433:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042439:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042445:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042849:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042855:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042860:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042866:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042871:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042877:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.042883:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043054:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043060:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043066:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043072:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043078:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043083:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043090:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043096:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043102:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043112:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043118:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043124:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043129:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043135:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043140:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043146:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043153:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043160:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043165:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043171:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043178:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043183:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043188:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043194:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043200:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043206:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043212:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043218:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043231:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043238:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043244:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043251:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043393:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043403:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043411:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043420:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.043430:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.045196:0:8207:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9af3fbf62600:8207] 2 exiting: rc = 0 00000100:00100000:2.0:1788687864.045658:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9af3c2e08a00:6691] 1 exiting: rc = 0 00000100:00100000:2.0:1788687864.045734:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9af3c841f000:6690] 0 exiting: rc = 1 00000100:00100000:3.0:1788687864.045857:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.045871:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.045882:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046244:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046252:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046258:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046335:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046342:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046348:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046355:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046361:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046366:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046372:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046378:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046384:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046391:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046396:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046402:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046408:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046414:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046420:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046426:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046432:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046437:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.046444:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.047454:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.047531:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048189:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048209:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048223:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048239:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048258:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048287:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048353:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048361:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048367:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048373:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048379:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048384:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048389:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048394:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048401:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048407:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048412:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048418:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048424:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048429:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048434:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048441:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048446:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048453:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048459:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048464:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048469:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048474:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048518:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048525:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048531:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048537:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048630:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048637:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048655:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048660:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.048671:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.056772:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9af3fbf59c00:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1788687864.071957:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9af3c841f200:6693] 1 exiting: rc = 0 00000100:00100000:0.0:1788687864.076630:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9af3fbf58600:6694] 2 exiting: rc = 0 00000100:00100000:2.0:1788687864.077106:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077116:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077123:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077130:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077137:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077145:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077150:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077157:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077163:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077169:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077175:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077181:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077187:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077196:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077202:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077209:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077218:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077228:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.077241:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078712:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078723:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078751:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078764:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078771:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078777:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078784:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078792:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078799:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078806:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078813:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078819:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078825:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078832:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078838:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078845:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078853:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078861:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078868:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078875:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.078882:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079585:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079594:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079609:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079617:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079624:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079657:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079664:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079671:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079677:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079684:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079690:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079697:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079705:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079712:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079736:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079744:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079752:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079759:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079766:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079773:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079779:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079785:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079791:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788687864.079797:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788687864.125126:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9af3c2e09200:6695] 0 exiting: rc = 1 00000100:00100000:3.0:1788687864.125349:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9af3c2e09400:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1788687864.125643:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125651:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125656:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125661:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125665:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125671:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125675:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125681:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125686:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125692:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125696:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125702:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125707:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125712:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125717:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125722:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125727:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125920:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125933:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125939:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125944:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125950:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125956:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125962:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125969:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125975:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.125981:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126086:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126111:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126117:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126124:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126130:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126136:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126142:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126149:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126155:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126161:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126167:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126174:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126179:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126186:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126193:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126199:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126205:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126211:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126218:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126223:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126229:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126233:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126239:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126244:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126250:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126256:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126262:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126269:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126274:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126282:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126291:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126297:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126308:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126315:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126324:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126332:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.126345:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788687864.127722:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9af3c50eba00:6698] 1 exiting: rc = 0 00000100:00100000:1.0:1788687864.127869:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9af3c2e08400:6697] 0 exiting: rc = 1 00000100:00100000:0.0:1788687864.127969:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.127978:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128094:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128106:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128114:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128122:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128129:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128137:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128146:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128153:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128160:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128180:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128189:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128195:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128202:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128209:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128214:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128221:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128228:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128236:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128243:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128249:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128255:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128278:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128286:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128293:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128300:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128308:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128315:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128322:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128328:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128335:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128350:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128357:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128380:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128402:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128410:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128416:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128423:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128430:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128437:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128444:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128450:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128458:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.128465:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130146:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130174:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130209:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130216:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130222:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130229:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130235:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130242:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130248:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130255:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130261:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130267:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130274:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130280:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130301:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130310:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130316:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130322:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788687864.130329:0:13377:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788687864.158317:0:13377:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788687882.311719:0:13997:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788687890.152970:0:14458:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788687890.152976:0:14458:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788687890.153088:0:14458:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9af2c1b98800 00000020:01000004:2.0:1788687890.153114:0:14458:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788687890.153122:0:14458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788687890.153137:0:14458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9af3f40d19c0) 00000020:00000080:2.0:1788687890.153152:0:14458:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788687890.167808:0:14458:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788687890.170109:0:14458:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788687890.170930:0:14458:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788687890.171042:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 279: rc = 0 00100000:10000000:3.0:1788687890.171225:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 279: rc = 0 00100000:10000000:3.0:1788687890.171364:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 279: rc = 0 00100000:10000000:3.0:1788687890.171965:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 279: rc = 0 00100000:10000000:3.0:1788687890.172072:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 279: rc = 0 00100000:10000000:3.0:1788687890.172196:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 279: rc = 0 00100000:10000000:3.0:1788687890.174312:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 512: rc = 0 00100000:10000000:3.0:1788687890.176795:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 282: rc = 0 00100000:10000000:3.0:1788687890.176904:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 282: rc = 0 00100000:10000000:3.0:1788687890.177582:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788687890.178040:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 451: rc = 0 00100000:10000000:3.0:1788687890.178429:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 451: rc = 0 00100000:10000000:3.0:1788687890.179462:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788687890.179958:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788687890.180406:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 451: rc = 0 00100000:10000000:3.0:1788687890.180824:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788687890.181154:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 451: rc = 0 00100000:10000000:3.0:1788687890.181787:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788687890.182061:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 451: rc = 0 00100000:10000000:3.0:1788687890.182411:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 451: rc = 0 00100000:10000000:3.0:1788687890.182946:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788687890.183528:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 782: rc = 0 00100000:10000000:3.0:1788687890.183786:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 782: rc = 0 00100000:10000000:3.0:1788687890.184091:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 782: rc = 0 00100000:10000000:3.0:1788687890.186043:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 782: rc = 0 00100000:10000000:3.0:1788687890.188722:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 782: rc = 0 00100000:10000000:3.0:1788687890.189553:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 782: rc = 0 00100000:10000000:3.0:1788687890.190513:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 782: rc = 0 00100000:10000000:3.0:1788687890.190792:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 782: rc = 0 00100000:10000000:3.0:1788687890.191063:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 782: rc = 0 00100000:10000000:3.0:1788687890.191370:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 782: rc = 0 00100000:10000000:3.0:1788687890.191646:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 782: rc = 0 00100000:10000000:3.0:1788687890.191900:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 782: rc = 0 00100000:10000000:3.0:1788687890.192162:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 782: rc = 0 00100000:10000000:3.0:1788687890.192429:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 782: rc = 0 00100000:10000000:3.0:1788687890.192727:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 782: rc = 0 00100000:10000000:3.0:1788687890.192998:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 782: rc = 0 00100000:10000000:3.0:1788687890.193284:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 782: rc = 0 00100000:10000000:3.0:1788687890.193885:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 782: rc = 0 00100000:10000000:3.0:1788687890.194517:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 782: rc = 0 00100000:10000000:3.0:1788687890.194772:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 782: rc = 0 00100000:10000000:3.0:1788687890.195019:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 782: rc = 0 00100000:10000000:3.0:1788687890.195308:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 782: rc = 0 00100000:10000000:3.0:1788687890.195593:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 782: rc = 0 00100000:10000000:3.0:1788687890.195832:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 782: rc = 0 00100000:10000000:3.0:1788687890.196062:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 782: rc = 0 00100000:10000000:3.0:1788687890.196347:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 782: rc = 0 00100000:10000000:3.0:1788687890.196894:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 782: rc = 0 00100000:10000000:3.0:1788687890.197292:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 782: rc = 0 00100000:10000000:3.0:1788687890.197694:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 782: rc = 0 00100000:10000000:3.0:1788687890.197975:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 782: rc = 0 00100000:10000000:3.0:1788687890.198467:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 782: rc = 0 00100000:10000000:3.0:1788687890.198753:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 782: rc = 0 00100000:10000000:3.0:1788687890.199422:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 771: rc = 0 00100000:10000000:3.0:1788687890.200032:0:14458:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788687890.200351:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 286: rc = 0 00100000:10000000:3.0:1788687890.200577:0:14458:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788687890.200651:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 286: rc = 0 00100000:10000000:3.0:1788687890.200840:0:14458:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788687890.200911:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 286: rc = 0 00100000:10000000:2.0:1788687890.201714:0:14458:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788687890.201811:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 283: rc = 0 00100000:10000000:2.0:1788687890.202003:0:14458:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788687890.202078:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 283: rc = 0 00100000:10000000:2.0:1788687890.202551:0:14458:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788687890.202626:0:14458:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 283: rc = 0 00000020:00000080:2.0:1788687890.202927:0:14458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788687890.202936:0:14458:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788687890.202946:0:14458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74449d19 00000020:01000004:2.0:1788687890.202956:0:14458:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788687890.202962:0:14458:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788687890.202967:0:14458:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9af2c1b98800 from MGS 00000020:01000004:2.0:1788687890.202972:0:14458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788687890.202982:0:14458:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9af3f40d4d40) 00000020:00000080:2.0:1788687890.202992:0:14458:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788687890.203058:0:14458:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af2c1b98800 from MGS, refs=2 00080000:01000000:2.0:1788687890.203064:0:14458:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788687890.203069:0:14458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74449d27 00000100:00100000:2.0:1788687890.203309:0:14458:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788687890.203448:0:14458:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788687890.203454:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788687890.203960:0:14458:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788687890.203967:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788687890.204639:0:14458:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788687890.204792:0:14458:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788687890.204797:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788687890.205441:0:14458:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788687890.205451:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788687890.205875:0:14458:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788687890.205883:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788687890.206589:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687890.206592:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687890.206594:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687890.206909:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687890.206911:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687890.206913:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687890.207467:0:14458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788687890.211713:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788687890.225631:0:14458:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788687890.225648:0:14458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788687890.225651:0:14458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788687890.230247:0:14467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788687890.230499:0:14458:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788687890.230606:0:14458:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788687890.231112:0:14458:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788687890.231532:0:14458:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788687890.231731:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788687890.231737:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788687890.232695:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788687890.232704:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788687890.237182:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788687890.237196:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788687890.238071:0:14458:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788687890.238108:0:14458:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.126@tcp' 00000020:01000004:3.0:1788687890.238111:0:14458:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788687890.238152:0:14458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.126@tcp (typ=mgc) 00000020:00000080:3.0:1788687890.238167:0:14458:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.126@tcp (ffff9af3c2ebb380) 00000020:00000080:3.0:1788687890.238184:0:14458:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788687890.238385:0:14458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af3f5899800@MGC192.168.204.126@tcp: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1788687890.238625:0:14458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.126@tcp-0 is initialized 00000040:01000000:3.0:1788687890.238633:0:14458:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788687890.238840:0:14472:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788687890.240030:0:14473:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788687890.240109:0:14458:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.126@tcp (uuid 77fc0cc6-2d57-47be-a26d-d352055b72d6) 00000020:00000080:3.0:1788687890.240139:0:14458:0:(genops.c:1385:class_connect()) connect: client 77fc0cc6-2d57-47be-a26d-d352055b72d6, cookie 0xc2ddd83e74449d35 00000100:00080000:3.0:1788687890.240156:0:14458:0:(import.c:545:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788687890.240163:0:14458:0:(import.c:665:import_select_connection()) MGC192.168.204.126@tcp: import ffff9af3f5899800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788687890.240194:0:14458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3fc1c5500 x1875574839660928/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788687890.240341:0:14458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 77fc0cc6-2d57-47be-a26d-d352055b72d6->MGS 00000020:01000004:3.0:1788687890.240364:0:14458:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788687890.240369:0:14458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788687890.240384:0:14458:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9af3c2eb8000) 00000020:00000080:3.0:1788687890.240396:0:14458:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788687890.240608:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:77fc0cc6-2d57-47be-a26d-d352055b72d6:3309:1875574839660928:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788687890.240676:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687890.240791:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839660928 00000100:00100000:1.0:1788687890.240807:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839660928 00000100:00100000:1.0:1788687890.240840:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788687890.240848:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875574839660928:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788687890.240869:0:14469:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 77fc0cc6-2d57-47be-a26d-d352055b72d6@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:1.0:1788687890.240890:0:14469:0:(genops.c:1385:class_connect()) connect: client 77fc0cc6-2d57-47be-a26d-d352055b72d6, cookie 0xc2ddd83e74449d43 00000100:00080000:1.0:1788687890.241012:0:14469:0:(import.c:65:import_set_state_nolock()) ffff9af3c8873000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687890.241073:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+5:3309:x1875574839660928:12345-0@lo:250:mount.lustre.0 Request processed in 225us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687890.241081:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788687890.241175:0:3309:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788687890.241184:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00080000:2.0:1788687890.241190:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788687890.241194:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788687890.241198:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f5899800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788687890.241200:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788687890.241220:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788687890.241225:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:77fc0cc6-2d57-47be-a26d-d352055b72d6:3309:1875574839660928:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788687890.257810:0:14458:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687890.257989:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788687890.257995:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788687890.263610:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788687890.263623:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788687890.263989:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788687890.263995:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788687890.264929:0:14458:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687890.265120:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788687890.265126:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788687890.265893:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788687890.265901:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788687890.295717:0:14458:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788687890.295902:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788687890.295908:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788687890.296975:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788687890.296983:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788687890.297670:0:14458:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788687890.297815:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788687890.297820:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788687890.298265:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788687890.298271:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788687890.298703:0:14458:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788687890.298829:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788687890.298834:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788687890.299343:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788687890.299348:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788687890.299907:0:14458:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788687890.300052:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788687890.300056:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788687890.300731:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788687890.300738:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788687890.316298:0:14458:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788687890.316713:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788687890.316720:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788687890.318006:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788687890.318016:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788687890.318931:0:14458:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788687890.318940:0:14458:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788687890.319892:0:14458:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788687890.319916:0:14458:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788687890.319922:0:14458:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788687890.320055:0:14458:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788687890.321027:0:14458:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788687890.321034:0:14458:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788687890.321035:0:14458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788687890.321037:0:14458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788687890.321038:0:14458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788687890.321039:0:14458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788687890.321107:0:14458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788687890.321108:0:14458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788687890.321110:0:14458:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788687890.321111:0:14458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788687890.321113:0:14458:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788687890.321116:0:14458:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788687890.321119:0:14458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788687890.321121:0:14458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788687890.321122:0:14458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788687890.321123:0:14458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788687890.321124:0:14458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788687890.321190:0:14458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788687890.321193:0:14458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788687890.321194:0:14458:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788687890.321195:0:14458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788687890.321196:0:14458:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788687890.321286:0:14458:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788687890.321308:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661056:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788687890.321394:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687890.321535:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.321713:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839661056 00000100:00100000:3.0:1788687890.321723:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839661056 00000100:00100000:3.0:1788687890.321818:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687890.321829:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+5:14458:x1875574839661056:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788687890.321877:0:14471:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788687890.321885:0:14471:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788687890.321888:0:14471:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788687890.322371:0:14492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788687890.322839:0:14471:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788687890.324048:0:14493:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788687890.324056:0:14493:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788687890.324059:0:14493:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788687890.324105:0:14493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788687890.324609:0:14471:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788687890.324622:0:14471:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788687890.330957:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+5:14458:x1875574839661056:12345-0@lo:253:mount.lustre.0 Request processed in 9119us (9552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687890.330976:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788687890.331403:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661056:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788687890.331421:0:14458:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788687890.331425:0:14458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788687890.331427:0:14458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788687890.331429:0:14458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788687890.331445:0:14458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788687890.331446:0:14458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788687890.331448:0:14458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788687890.331450:0:14458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788687890.331451:0:14458:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788687890.331453:0:14458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788687890.331455:0:14458:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788687890.331474:0:14458:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9af2c1b98800 from lustre-MDT0000 10000000:01000000:1.0:1788687890.331787:0:14458:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788687890.331792:0:14458:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788687890.331797:0:14458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9af3c2ebb380 10000000:01000000:1.0:1788687890.331801:0:14458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788687890.331811:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af3c2ebb380 from 1 10000000:01000000:1.0:1788687890.331814:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788687890.331853:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.331866:0:14458:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.331876:0:14458:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687890.331896:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788687890.332768:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687890.332839:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687890.332879:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839661184 00000100:00100000:1.0:1788687890.332885:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839661184 00000100:00100000:1.0:1788687890.332956:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788687890.332965:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+5:14458:x1875574839661184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788687890.332980:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687890.332998:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cc800/0xc2ddd83e74449d51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449d4a expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.333046:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cc800/0xc2ddd83e74449d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449d4a expref: 6 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.333057:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cc800/0xc2ddd83e74449d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449d4a expref: 6 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.333066:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc800, rc 0) 00000100:00100000:0.0:1788687890.334333:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788687890.334359:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d51 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.334371:0:14458:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449d51 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687890.334450:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788687890.334530:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687890.334566:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788687890.334668:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+6:14458:x1875574839661184:12345-0@lo:101:mount.lustre.0 Request processed in 163us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.334674:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839661312 00000100:00100000:1.0:1788687890.334677:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788687890.334679:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839661312 00000100:00100000:3.0:1788687890.334722:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788687890.334730:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+6:14458:x1875574839661312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788687890.334990:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+6:14458:x1875574839661312:12345-0@lo:501:mount.lustre.0 Request processed in 260us (460us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788687890.334997:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788687890.336330:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661312:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788687890.336378:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788687890.336403:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d51 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.336414:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d51 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687890.336424:0:14458:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9af2c1b98800 10000000:01000000:0.0:1788687890.336430:0:14458:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788687890.336434:0:14458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9af2c1b98800 10000000:01000000:0.0:1788687890.336437:0:14458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788687890.336440:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9af2c1b98800 from 1 10000000:01000000:0.0:1788687890.336453:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788687890.336509:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed200/0xc2ddd83e74449d58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.336518:0:14458:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed200/0xc2ddd83e74449d58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.336528:0:14458:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed200/0xc2ddd83e74449d58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687890.336547:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788687890.336592:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687890.336629:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.337169:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839661440 00000100:00100000:3.0:1788687890.337176:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839661440 00000100:00100000:3.0:1788687890.337289:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788687890.337298:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+6:14458:x1875574839661440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788687890.337311:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687890.337328:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aac800/0xc2ddd83e74449d5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449d58 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687890.337350:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aac800/0xc2ddd83e74449d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449d58 expref: 7 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687890.337361:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aac800/0xc2ddd83e74449d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449d58 expref: 7 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687890.337370:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac800, rc 0) 00000100:00100000:3.0:1788687890.337419:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+7:14458:x1875574839661440:12345-0@lo:101:mount.lustre.0 Request processed in 123us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.337435:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788687890.337671:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788687890.337686:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed200/0xc2ddd83e74449d58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d5f expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.337695:0:14458:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed200/0xc2ddd83e74449d58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449d5f expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687890.337713:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788687890.337728:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed200/0xc2ddd83e74449d58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d5f expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.337735:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed200/0xc2ddd83e74449d58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d5f expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687890.337742:0:14458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788687890.337746:0:14458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788687890.337765:0:14458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9af2c1b98800 10000000:01000000:0.0:1788687890.337769:0:14458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788687890.337772:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788687890.337775:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788687890.337796:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79eda00/0xc2ddd83e74449d66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.337804:0:14458:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f79eda00/0xc2ddd83e74449d66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.337811:0:14458:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f79eda00/0xc2ddd83e74449d66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687890.337827:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788687890.337857:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687890.337888:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788687890.338027:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839661568 00000100:00100000:2.0:1788687890.338033:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839661568 00000100:00100000:2.0:1788687890.338079:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788687890.338087:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+7:14458:x1875574839661568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788687890.338108:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687890.338120:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f15d3600/0xc2ddd83e74449d6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449d66 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.338159:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f15d3600/0xc2ddd83e74449d6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449d66 expref: 8 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.338168:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f15d3600/0xc2ddd83e74449d6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449d66 expref: 8 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.338175:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3600, rc 0) 00000100:00100000:2.0:1788687890.338215:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+8:14458:x1875574839661568:12345-0@lo:101:mount.lustre.0 Request processed in 129us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687890.338221:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788687890.338354:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788687890.338365:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f79eda00/0xc2ddd83e74449d66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d6d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.338373:0:14458:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f79eda00/0xc2ddd83e74449d66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449d6d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687890.338422:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788687890.338448:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687890.338472:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788687890.338533:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839661696 00000100:00100000:1.0:1788687890.338537:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839661696 00000100:00100000:1.0:1788687890.338567:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788687890.338574:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+8:14458:x1875574839661696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687890.338966:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+9:14458:x1875574839661696:12345-0@lo:501:mount.lustre.0 Request processed in 392us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687890.338973:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788687890.339054:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788687890.339089:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788687890.339314:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687890.339342:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788687890.339523:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839661824 00000100:00100000:1.0:1788687890.339529:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839661824 00000100:00100000:1.0:1788687890.339552:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788687890.339559:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+9:14458:x1875574839661824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788687890.339888:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+9:14458:x1875574839661824:12345-0@lo:503:mount.lustre.0 Request processed in 329us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687890.339895:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788687890.340435:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839661824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788687890.340844:0:14494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14494:1875574839661952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687890.340895:0:14494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687890.340941:0:14494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c11ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1788687890.341022:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839661952 00000100:00100000:2.0:1788687890.341027:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839661952 00000100:00100000:2.0:1788687890.341074:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788687890.341082:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+9:14494:x1875574839661952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687890.341587:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+9:14494:x1875574839661952:12345-0@lo:502:llog_process_th.0 Request processed in 504us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687890.341594:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788687890.341854:0:14494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14494:1875574839661952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788687890.341882:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687890.341893:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687890.341896:0:14494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788687890.341901:0:14494:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788687890.341905:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788687890.342026:0:14494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9af3c2ebcd40) 00000020:00000080:3.0:1788687890.342057:0:14494:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788687890.342064:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788687890.342324:0:14494:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788687890.342332:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74449d7b 00000020:00000080:3.0:1788687890.342660:0:14494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788687890.342665:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687890.342668:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687890.342670:0:14494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788687890.342672:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687890.342676:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687890.342678:0:14494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788687890.342681:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788687890.342688:0:14494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9af3c2eb99c0) 00000020:00000080:3.0:1788687890.342698:0:14494:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788687890.342702:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788687890.342704:0:14494:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788687890.342706:0:14494:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788687890.342713:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788687890.342760:0:14494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af2c1b98800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788687890.342782:0:14494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9af3c2fb8000) 00000020:00000080:3.0:1788687890.342791:0:14494:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788687890.342846:0:14494:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788687890.342851:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2ddd83e74449d90 00000020:00000080:3.0:1788687890.343302:0:14494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788687890.343310:0:14494:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788687890.343315:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc2ddd83e74449d97 00080000:01000000:3.0:1788687890.343321:0:14494:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788687890.343325:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74449d9e 00010000:00010000:2.0:1788687890.401716:0:14494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788687890.402345:0:14494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788687890.402619:0:14494:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788687890.403319:0:14494:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9af3f40d3380) 00000020:00000080:2.0:1788687890.403342:0:14494:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788687890.403422:0:14494:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788687890.403430:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74449dac 00000020:00000080:3.0:1788687890.404025:0:14494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788687890.412400:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc2ddd83e74449db3 00000020:00000080:3.0:1788687890.412742:0:14494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788687890.412757:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687890.412765:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687890.412769:0:14494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788687890.412772:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788687890.412775:0:14494:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788687890.412776:0:14494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788687890.412778:0:14494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788687890.412779:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788687890.412782:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687890.412783:0:14494:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788687890.412785:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687890.412790:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687890.412791:0:14494:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788687890.412796:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788687890.412833:0:14494:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788687890.412844:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687890.412847:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687890.412848:0:14494:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788687890.412850:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788687890.412854:0:14494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788687890.412857:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687890.412864:0:14494:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788687890.412868:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788687890.412874:0:14494:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:3.0:1788687890.412902:0:14494:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788687890.412905:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788687890.412921:0:14494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9af3c2fbcd40) 00000020:00000080:3.0:1788687890.412936:0:14494:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788687890.412941:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788687890.413007:0:14494:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788687890.413013:0:14494:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788687890.413021:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74449dc1 00010000:00080000:3.0:1788687890.413061:0:14494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af3f3675000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1788687890.413315:0:14494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788687890.413686:0:14494:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788687890.413736:0:14494:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788687890.418673:0:14494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788687890.418752:0:14494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788687890.418846:0:14494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788687890.419413:0:14498:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788687890.419419:0:14498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788687890.421007:0:14494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788687890.421021:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788687890.421057:0:14494:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788687890.421224:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2ddd83e74449dc8 00000100:00080000:0.0:1788687890.421236:0:14494:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788687890.421243:0:14494:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9af3f3675000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788687890.421282:0:14494:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3c697d180 x1875574839662080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788687890.421359:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839662080:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788687890.421420:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875574839662080 offset 0 length 520: 4 00000100:00080000:0.0:1788687890.421511:0:14494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788687890.421574:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687890.421579:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.421581:0:14494:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788687890.421584:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788687890.421587:0:14494:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788687890.421589:0:14494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788687890.421590:0:14494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788687890.421592:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788687890.421594:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.421595:0:14494:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788687890.421598:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788687890.421602:0:14494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788687890.421605:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.421607:0:14494:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788687890.421610:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788687890.421613:0:14494:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:0.0:1788687890.421635:0:14494:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788687890.421638:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788687890.421661:0:14494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9af3c5b4cd40) 00000020:00000080:0.0:1788687890.421672:0:14494:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788687890.421679:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788687890.421732:0:14494:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788687890.421739:0:14494:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788687890.421745:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2ddd83e74449dd6 00010000:00080000:0.0:1788687890.421774:0:14494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af3fc393000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1788687890.421979:0:14494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788687890.422268:0:14494:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788687890.422291:0:14494:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788687890.422837:0:14494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788687890.422901:0:14494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788687890.422986:0:14494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788687890.423946:0:14500:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788687890.423952:0:14500:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788687890.424777:0:14494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788687890.424789:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788687890.424819:0:14494:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788687890.424837:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2ddd83e74449ddd 00000100:00080000:0.0:1788687890.424846:0:14494:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788687890.424852:0:14494:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9af3fc393000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788687890.424886:0:14494:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3c697c700 x1875574839662208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788687890.424909:0:14494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788687890.424953:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687890.424957:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.424959:0:14494:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788687890.424962:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687890.424966:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.424968:0:14494:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788687890.424971:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788687890.424972:0:14494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788687890.424975:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687890.424983:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.424985:0:14494:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788687890.424987:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687890.424990:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.424991:0:14494:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788687890.424995:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788687890.425026:0:14494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14494:1875574839662336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687890.425242:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839662208:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788687890.425284:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875574839662208 offset 0 length 520: 4 00000100:00100000:0.0:1788687890.425633:0:14494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687890.425693:0:14494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8a8be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.425742:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839662336 00000100:00100000:3.0:1788687890.425750:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839662336 00000100:00100000:3.0:1788687890.425836:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788687890.425847:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+9:14494:x1875574839662336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687890.426346:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+9:14494:x1875574839662336:12345-0@lo:502:llog_process_th.0 Request processed in 500us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.426355:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788687890.426432:0:14494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14494:1875574839662336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788687890.426461:0:14494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687890.426467:0:14494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.426469:0:14494:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788687890.426474:0:14494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788687890.427036:0:14458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788687890.427060:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788687890.427244:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79eda00/0xc2ddd83e74449d66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d6d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.427258:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f79eda00/0xc2ddd83e74449d66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d6d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687890.427268:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af2c1b98800 from 1 10000000:01000000:2.0:1788687890.427271:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788687890.427311:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.427320:0:14458:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.427330:0:14458:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687890.427349:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839662464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788687890.427406:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687890.427514:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c681cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.427721:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839662464 00000100:00100000:3.0:1788687890.427729:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839662464 00000100:00100000:3.0:1788687890.427814:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788687890.427833:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+9:14458:x1875574839662464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788687890.427848:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687890.427864:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74449deb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449de4 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687890.427888:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74449deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449de4 expref: 10 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687890.427900:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74449deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449de4 expref: 10 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687890.427909:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad800, rc 0) 00000100:00100000:3.0:1788687890.427950:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+10:14458:x1875574839662464:12345-0@lo:101:mount.lustre.0 Request processed in 118us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.427957:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788687890.428061:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839662464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788687890.428087:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.428108:0:14458:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687890.428915:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839662592:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788687890.428963:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687890.429042:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c681cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.429279:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839662592 00000100:00100000:3.0:1788687890.429285:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839662592 00000100:00100000:3.0:1788687890.429317:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788687890.429324:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+10:14458:x1875574839662592:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788687890.429340:0:14471:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788687890.429346:0:14471:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788687890.429424:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+10:14458:x1875574839662592:12345-0@lo:256:mount.lustre.0 Request processed in 100us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.429431:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788687890.429529:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839662592:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788687890.430221:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788687890.430241:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.430252:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687890.430260:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af2c1b98800 from 1 10000000:01000000:1.0:1788687890.430263:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687890.430293:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.430301:0:14458:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.430310:0:14458:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687890.430328:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839662720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788687890.430365:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687890.430391:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.430500:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839662720 00000100:00100000:3.0:1788687890.430505:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839662720 00000100:00100000:3.0:1788687890.430530:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788687890.430536:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+10:14458:x1875574839662720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788687890.430556:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687890.430570:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74449df9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449df2 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687890.430591:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74449df9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449df2 expref: 11 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687890.430600:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74449df9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449df2 expref: 11 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687890.430609:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aade00, rc 0) 00000100:00100000:3.0:1788687890.430644:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14458:x1875574839662720:12345-0@lo:101:mount.lustre.0 Request processed in 107us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.430649:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788687890.430734:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839662720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788687890.430748:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.430757:0:14458:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687890.430822:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839662848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687890.430849:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687890.430875:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687890.430940:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839662848 00000100:00100000:2.0:1788687890.430944:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839662848 00000100:00100000:2.0:1788687890.430963:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788687890.430968:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14458:x1875574839662848:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788687890.431427:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14458:x1875574839662848:12345-0@lo:501:mount.lustre.0 Request processed in 458us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687890.431434:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788687890.431609:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839662848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687890.431639:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839662976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788687890.431676:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687890.431693:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.431751:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839662976 00000100:00100000:3.0:1788687890.431755:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839662976 00000100:00100000:3.0:1788687890.431776:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788687890.431781:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14458:x1875574839662976:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788687890.431926:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14458:x1875574839662976:12345-0@lo:503:mount.lustre.0 Request processed in 144us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.431933:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788687890.431998:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839662976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788687890.432943:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a81880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14502:1875574839663104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687890.432994:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687890.433055:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c68e3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.433223:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839663104 00000100:00100000:3.0:1788687890.433229:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839663104 00000100:00100000:3.0:1788687890.433301:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788687890.433310:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14502:x1875574839663104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687890.433650:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14502:x1875574839663104:12345-0@lo:502:llog_process_th.0 Request processed in 339us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.433666:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788687890.433741:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a81880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14502:1875574839663104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788687890.433769:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687890.433780:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.433782:0:14502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788687890.433790:0:14502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af2c1b98800 00000020:00000080:0.0:1788687890.433792:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788687890.433801:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687890.433803:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.433804:0:14502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788687890.433806:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687890.433808:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.433810:0:14502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788687890.433812:0:14502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af2c1b98800 00000020:00000080:0.0:1788687890.433814:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788687890.433871:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687890.433874:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.433875:0:14502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788687890.433883:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687890.433886:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687890.433887:0:14502:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788687890.433890:0:14502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9af2c1b98800 00000020:00000080:0.0:1788687890.433892:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788687890.433928:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14502:1875574839663232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788687890.433962:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687890.443620:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839663232 00000100:00100000:2.0:1788687890.443639:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839663232 00000100:00100000:2.0:1788687890.443707:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788687890.443719:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14502:x1875574839663232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687890.444035:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14502:x1875574839663232:12345-0@lo:502:llog_process_th.0 Request processed in 318us (10071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687890.444043:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788687890.449660:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8a8be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.449709:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14502:1875574839663232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788687890.449756:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687890.449764:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687890.449766:0:14502:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788687890.449770:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788687890.450028:0:14458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788687890.450051:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788687890.450194:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.450207:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687890.450255:0:14458:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788687890.450258:0:14458:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9af2c1b98800 10000000:01000000:1.0:1788687890.450261:0:14458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9af2c1b98800 10000000:01000000:1.0:1788687890.450265:0:14458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788687890.450271:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af2c1b98800 from 1 10000000:01000000:1.0:1788687890.450274:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788687890.450307:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cce00/0xc2ddd83e74449e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.450316:0:14458:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38cce00/0xc2ddd83e74449e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.450332:0:14458:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38cce00/0xc2ddd83e74449e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687890.450354:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839663360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788687890.450423:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687890.450459:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8257a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788687890.450813:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839663360 00000100:00100000:2.0:1788687890.450820:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839663360 00000100:00100000:2.0:1788687890.450867:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788687890.450877:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14458:x1875574839663360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788687890.450892:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687890.450906:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f15d2400/0xc2ddd83e74449e07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449e00 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.450931:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f15d2400/0xc2ddd83e74449e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449e00 expref: 12 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.450943:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f15d2400/0xc2ddd83e74449e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449e00 expref: 12 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.450953:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2400, rc 0) 00000100:00100000:2.0:1788687890.451001:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14458:x1875574839663360:12345-0@lo:101:mount.lustre.0 Request processed in 125us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687890.451007:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788687890.453290:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839663360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788687890.453316:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38cce00/0xc2ddd83e74449e00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e07 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.453329:0:14458:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cce00/0xc2ddd83e74449e00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449e07 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687890.453406:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839663488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687890.453460:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687890.453517:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8257a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788687890.456297:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839663488 00000100:00100000:2.0:1788687890.456309:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839663488 00000100:00100000:2.0:1788687890.456358:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788687890.456368:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14458:x1875574839663488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788687890.457545:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14458:x1875574839663488:12345-0@lo:501:mount.lustre.0 Request processed in 1174us (4080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687890.457565:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788687890.457922:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839663488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687890.457974:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839663616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788687890.458019:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687890.458053:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8257a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.459507:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839663616 00000100:00100000:3.0:1788687890.459518:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839663616 00000100:00100000:3.0:1788687890.459561:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788687890.459571:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14458:x1875574839663616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788687890.459793:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14458:x1875574839663616:12345-0@lo:503:mount.lustre.0 Request processed in 223us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.459801:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788687890.460310:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839663616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788687890.467237:0:14507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14507:1875574839663744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687890.467324:0:14507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687890.467374:0:14507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c68e3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.467378:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839663744 00000100:00100000:3.0:1788687890.467387:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839663744 00000100:00100000:3.0:1788687890.467448:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788687890.467460:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14507:x1875574839663744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687890.467769:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14507:x1875574839663744:12345-0@lo:502:llog_process_th.0 Request processed in 311us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.467777:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788687890.467979:0:14507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14507:1875574839663744:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788687890.468045:0:14507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788687890.468063:0:14507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9af3f40d0000) 00000020:00000080:2.0:1788687890.468114:0:14507:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788687890.470389:0:14507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af2c1b98800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788687890.470396:0:14507:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af2c1b98800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788687890.470400:0:14507:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af2c1b98800 4 00010000:00080000:2.0:1788687890.470437:0:14507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af3f40e3800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1788687890.474039:0:14507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788687890.474508:0:14507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788687890.474543:0:14507:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788687890.474556:0:14507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc2ddd83e74449e15 00000100:00080000:2.0:1788687890.474566:0:14507:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788687890.474572:0:14507:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9af3f40e3800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788687890.474605:0:14507:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af2c2a82300 x1875574839663872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788687890.474630:0:14507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788687890.474900:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875574839663872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788687890.474975:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687890.476255:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839663872 00000100:00100000:2.0:1788687890.476266:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839663872 00000100:00100000:2.0:1788687890.476310:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788687890.476318:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875574839663872:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788687890.476565:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875574839663872:12345-0@lo:38:llog_process_th.0 Request processed in 244us (1588us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788687890.476580:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788687890.476963:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788687890.476974:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f40e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788687890.476979:0:3309:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788687890.476989:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875574839663872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788687890.477160:0:14507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14507:1875574839664000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788687890.477234:0:14507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687890.477997:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839664000 00000100:00100000:2.0:1788687890.478006:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839664000 00000100:00100000:2.0:1788687890.478237:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788687890.478247:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14507:x1875574839664000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788687890.478560:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14507:x1875574839664000:12345-0@lo:502:llog_process_th.0 Request processed in 314us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687890.478568:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788687890.478811:0:14507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6eac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687890.478839:0:14507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77fc0cc6-2d57-47be-a26d-d352055b72d6:14507:1875574839664000:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788687890.478876:0:14507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788687890.479026:0:14458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788687890.479049:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788687890.479083:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cce00/0xc2ddd83e74449e00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e07 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.479107:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cce00/0xc2ddd83e74449e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e07 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788687890.479284:0:14458:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788687890.479287:0:14458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788687890.479289:0:14458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687890.479290:0:14458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687890.479292:0:14458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687890.479293:0:14458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687890.479294:0:14458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788687890.479295:0:14458:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788687890.479297:0:14458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687890.479299:0:14458:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788687890.479303:0:14458:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788687890.479305:0:14458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788687890.479307:0:14458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788687890.479308:0:14458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687890.479309:0:14458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687890.479310:0:14458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687890.479311:0:14458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687890.479313:0:14458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788687890.479314:0:14458:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788687890.479315:0:14458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687890.479321:0:14458:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788687890.479339:0:14458:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788687890.479354:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839664128:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788687890.479399:0:14458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687890.479431:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8a8b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687890.479851:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839664128 00000100:00100000:3.0:1788687890.479858:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839664128 00000100:00100000:3.0:1788687890.479914:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788687890.479925:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14458:x1875574839664128:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788687890.479948:0:14471:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788687890.479961:0:14471:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788687890.536993:0:14471:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788687890.537013:0:14471:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788687890.537040:0:14492:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788687890.537046:0:14492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788687890.537086:0:14492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.537117:0:14492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74449deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449de4 expref: 12 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.537198:0:14492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.537245:0:14492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74449deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74449de4 expref: 12 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687890.537263:0:14492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74449deb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74449de4 expref: 12 pid: 14471 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687890.537280:0:14492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14492:1875574839664256:0@lo:104: 00000100:00100000:1.0:1788687890.537354:0:14492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687890.537430:0:14492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8257780 going to sleep for 11 seconds 00000100:00100000:0.0:1788687890.537578:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839664256 00000100:00100000:0.0:1788687890.537597:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839664256 00000100:00100000:0.0:1788687890.537647:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788687890.537657:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+3:14492:x1875574839664256:12345-0@lo:104: 00010000:00010000:0.0:1788687890.537671:0:14459:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.537865:0:14459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788687890.537872:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+3:14492:x1875574839664256:12345-0@lo:104: Request processed in 217us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687890.537878:0:14492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14492:1875574839664256:0@lo:104: 00000100:00100000:0.0:1788687890.537880:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788687890.537899:0:14492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.537920:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687890.537925:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.537933:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3200 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687890.537937:0:14465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.537945:0:14465:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687890.537952:0:14465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687890.537966:0:14465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788687890.538057:0:14465:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.538065:0:14465:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687890.538102:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687890.538120:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77fc0cc6-2d57-47be-a26d-d352055b72d6:3311:1875574839664384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687890.538152:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788687890.538210:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3f15d3200/0xc2ddd83e74449de4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449deb expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687890.538226:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839664384 00010000:00010000:2.0:1788687890.538229:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687890.538231:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839664384 00010000:00010000:2.0:1788687890.538232:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687890.538234:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687890.538251:0:14461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74449deb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449de4 expref: 13 pid: 14471 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687890.538321:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788687890.538330:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+13:3311:x1875574839664384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788687890.538340:0:14461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687890.538345:0:14461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74449deb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449de4 expref: 13 pid: 14471 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538365:0:14461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74449deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74449de4 expref: 13 pid: 14471 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538378:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aad800/0xc2ddd83e74449deb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74449de4 expref: 13 pid: 14471 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538406:0:14461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538415:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788687890.538430:0:14461:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001384456s 00010000:00010000:0.0:1788687890.538434:0:14461:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538442:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538450:0:14461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538457:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538464:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc600 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687890.538469:0:14461:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538512:0:14461:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538534:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.538541:0:14492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687890.538543:0:14461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788687890.538548:0:14492:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687890.538555:0:14492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38cc600/0xc2ddd83e74449e1c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687890.538592:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:3311:x1875574839664384:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687890.538600:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788687890.539117:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77fc0cc6-2d57-47be-a26d-d352055b72d6:3311:1875574839664384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687890.548292:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:14458:1875574839664128:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788687890.548311:0:14458:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788687890.548315:0:14458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788687890.548317:0:14458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788687890.548318:0:14458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687890.548319:0:14458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687890.548321:0:14458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687890.548322:0:14458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687890.548323:0:14458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788687890.548324:0:14458:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788687890.548326:0:14458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687890.548327:0:14458:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788687890.548342:0:14458:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788687890.548708:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14458:x1875574839664128:12345-0@lo:253:mount.lustre.0 Request processed in 68192us (68714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687890.548722:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00080000:10000000:1.0:1788687890.556473:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788687890.556694:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788687890.562753:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788687890.563261:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788687890.563579:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788687890.565381:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788687890.570798:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788687890.571002:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687890.571534:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687890.571765:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687890.572194:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687890.573053:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788687890.645758:0:14458:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788687890.646151:0:14458:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788687890.646452:0:14514:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788687890.646457:0:14514:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788687890.646723:0:14515:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788687890.646798:0:14515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788687890.649986:0:14515:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788687890.650079:0:14515:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788687890.650084:0:14515:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788687890.651802:0:14458:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788687890.651919:0:14458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788687890.652408:0:14458:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788687890.652416:0:14458:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788687890.652580:0:14458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788687890.654024:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788687890.654797:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788687890.654838:0:14458:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788687890.660877:0:14458:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788687890.669472:0:14458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788687890.710224:0:14458:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788687890.710269:0:14458:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9c601ce7988 00100000:10000000:2.0:1788687890.710433:0:14458:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788687890.711465:0:14458:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788687890.711505:0:14458:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788687890.711521:0:14458:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788687890.711548:0:14458:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788687891.272022:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788687891.527901:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788687891.909722:0:14473:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788687891.909730:0:14473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af2c1b98800 from 6 10000000:01000000:3.0:1788687891.909737:0:14473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788687891.910288:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687891.910302:0:14473:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687891.910314:0:14473:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687891.910346:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839664512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788687891.910474:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687891.910545:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6eac9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687891.910545:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839664512 00000100:00100000:2.0:1788687891.910557:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839664512 00000100:00100000:2.0:1788687891.910628:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788687891.910639:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14473:x1875574839664512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687891.910656:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687891.910672:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f15d2000/0xc2ddd83e74449e2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449e23 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687891.910708:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f15d2000/0xc2ddd83e74449e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449e23 expref: 12 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687891.910720:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f15d2000/0xc2ddd83e74449e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449e23 expref: 12 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687891.910730:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2000, rc 0) 00000100:00100000:2.0:1788687891.910775:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14473:x1875574839664512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687891.910782:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788687891.911050:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839664512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788687891.911079:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687891.911090:0:14473:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687891.911138:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839664640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788687891.911168:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687891.911237:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6eac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687891.913647:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839664640 00000100:00100000:1.0:1788687891.913661:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839664640 00000100:00100000:0.0:1788687891.913897:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788687891.913975:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14473:x1875574839664640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788687891.914007:0:14471:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788687891.914025:0:14471:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788687891.914029:0:14471:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788687891.914195:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14473:x1875574839664640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 286us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687891.914205:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788687891.914223:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839664640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788687891.914299:0:14473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788687891.914309:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687891.914331:0:14473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687892.294340:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788687892.551998:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788687893.322755:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687894.350135:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788687894.949941:0:14757:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788687895.365896:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788687895.621798:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788687895.621806:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788687895.621817:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788687895.621821:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788687895.621824:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788687895.621827:0:12639:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788687895.621831:0:12639:0:(import.c:65:import_set_state_nolock()) ffff9af3f40e3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788687895.621843:0:12639:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9af3f40e3800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788687895.621878:0:12639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3fc1c5180 x1875574839664896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788687895.621920:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788687895.621923:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875574839664896:0@lo:38:kworker.0 00000100:00100000:2.0:1788687895.621928:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839664768:0@lo:400:kworker.0 00000100:00100000:3.0:1788687895.622069:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687895.622299:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839664896 00000100:00100000:1.0:1788687895.622317:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839664896 00000100:00100000:1.0:1788687895.622361:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788687895.622368:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875574839664896:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788687895.622395:0:14478:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1788687895.622432:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc2ddd83e74449e31 00000004:00100000:1.0:1788687895.622460:0:14478:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788687895.622619:0:14478:0:(import.c:65:import_set_state_nolock()) ffff9af3c7298800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687895.622672:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875574839664896:12345-0@lo:38:kworker.0 Request processed in 303us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687895.622680:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788687895.622681:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687895.622771:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839664768 00000100:00100000:2.0:1788687895.622776:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839664768 00000100:00100000:2.0:1788687895.622821:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788687895.622828:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:3313:x1875574839664768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687895.623024:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:3313:x1875574839664768:12345-0@lo:400:kworker.0 Request processed in 196us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687895.623032:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788687895.623176:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839664768:0@lo:400:kworker.0 00010000:00080000:3.0:1788687895.623717:0:3309:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9af3fc1c5180 x1875574839664896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788687905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788687895.623734:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788687895.623742:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788687895.623748:0:3309:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788687895.623750:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f40e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788687895.623756:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875574839664896:0@lo:38:kworker.0 00010000:00010000:3.0:1788687896.401287:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687897.415062:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788687897.932654:0:14908:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde5b57430 20000000:00000080:1.0:1788687897.932681:0:14908:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af3ee479c00 uarg=0000000000000000 20000000:01000000:1.0:1788687897.932727:0:14908:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788687897.932737:0:14908:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788687897.932743:0:14908:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788687897.934080:0:14909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788687897.935651:0:14908:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788687897.953792:0:14908:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788687897.954316:0:14908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687897.954341:0:14908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74449df9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449df2 expref: 11 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687897.954351:0:14908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687897.954408:0:14908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74449df9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74449df2 expref: 11 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687897.954439:0:14908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74449df9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74449df2 expref: 11 pid: 14471 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687897.954884:0:14908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14908:1875574839665024:0@lo:104: 00000100:00100000:0.0:1788687897.955230:0:14908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687897.955290:0:14908:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c1532f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788687897.955774:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839665024 00000100:00100000:1.0:1788687897.955784:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839665024 00000100:00100000:1.0:1788687897.955835:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788687897.955844:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+3:14908:x1875574839665024:12345-0@lo:104: 00010000:00010000:1.0:1788687897.955860:0:14459:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687897.955930:0:14459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788687897.955935:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+3:14908:x1875574839665024:12345-0@lo:104: Request processed in 94us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687897.955942:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788687897.955972:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687897.955988:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956000:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd200 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:3.0:1788687897.956006:0:14465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956018:0:14465:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788687897.956026:0:14465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687897.956033:0:14465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788687897.956128:0:14465:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956140:0:14465:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788687897.956179:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956187:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449df2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449df9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956211:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687897.956213:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687897.956215:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687897.956237:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839665152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687897.956309:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687897.956341:0:14908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14908:1875574839665024:0@lo:104: 00010000:00010000:0.0:1788687897.956379:0:14908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687897.956449:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839665152 00000100:00100000:3.0:1788687897.956458:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839665152 00010000:00010000:3.0:1788687897.956510:0:14462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74449df9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449df2 expref: 12 pid: 14471 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687897.956552:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687897.956562:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:3313:x1875574839665152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687897.956577:0:14462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687897.956582:0:14462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74449df9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449df2 expref: 12 pid: 14471 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956595:0:14462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74449df9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74449df2 expref: 12 pid: 14471 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956612:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aade00/0xc2ddd83e74449df9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74449df2 expref: 12 pid: 14471 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956636:0:14462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956645:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956663:0:14462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956671:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956679:0:14462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956687:0:14462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956693:0:14462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687897.956697:0:14462:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956705:0:14462:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956718:0:14462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687897.956729:0:14462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687897.956765:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:3313:x1875574839665152:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687897.956778:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687897.956816:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839665152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788687897.957014:0:14908:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687897.957026:0:14908:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687897.957052:0:14908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e38 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687898.439428:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788687899.461584:0:14473:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788687899.461597:0:14473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af2c1b98800 from 10 10000000:01000000:1.0:1788687899.461606:0:14473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687899.461680:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687899.461695:0:14473:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687899.461709:0:14473:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687899.461745:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839665280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788687899.461857:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687899.461947:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c85706c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788687899.462078:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687899.462735:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839665280 00000100:00100000:2.0:1788687899.462749:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839665280 00000100:00100000:2.0:1788687899.462867:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788687899.462879:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+11:14473:x1875574839665280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687899.462900:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687899.462931:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f15d3000/0xc2ddd83e74449e46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449e3f expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687899.462963:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f15d3000/0xc2ddd83e74449e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449e3f expref: 12 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687899.462976:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f15d3000/0xc2ddd83e74449e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449e3f expref: 12 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687899.462997:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d3000, rc 0) 00000100:00100000:2.0:1788687899.463088:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14473:x1875574839665280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687899.463095:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788687899.463205:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839665280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788687899.463227:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687899.463237:0:14473:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687899.463326:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839665408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687899.463379:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687899.467085:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c68e3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687899.467094:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839665408 00000100:00100000:1.0:1788687899.467163:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839665408 00000100:00100000:1.0:1788687899.467335:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788687899.467348:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14473:x1875574839665408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687899.467826:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14473:x1875574839665408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 481us (4446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687899.467837:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788687899.468022:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839665408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687899.468092:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839665536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687899.468147:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687899.468178:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c68e3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687899.469734:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839665536 00000100:00100000:1.0:1788687899.469751:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839665536 00000100:00100000:1.0:1788687899.469808:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788687899.469821:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14473:x1875574839665536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687899.471520:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:14473:x1875574839665536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1687us (3357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687899.471535:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788687899.471554:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839665536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788687899.476138:0:14971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788687899.476373:0:14473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788687899.477746:0:14473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788687899.477768:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687899.477784:0:14473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687900.487066:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687900.741576:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788687890/real 1788687890] req@ffff9af3c697c700 x1875574839662208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788687900 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687900.741618:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9af3c697c700 x1875574839662208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788687900 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687900.741631:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788687890/real 1788687890] req@ffff9af3c697d180 x1875574839662080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788687900 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687900.741644:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9af3c697d180 x1875574839662080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788687900 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788687900.741667:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3fc393000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788687900.741695:0:3309:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788687900.741700:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839662208:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788687900.741708:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f3675000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788687900.741714:0:3309:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788687900.741718:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839662080:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788687900.741957:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788687900.741962:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788687900.741966:0:36:0:(import.c:65:import_set_state_nolock()) ffff9af3f3675000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788687900.741972:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:3.0:1788687900.741980:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788687900.741998:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9af3f3675000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788687900.742025:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3fc1c6a00 x1875574839665792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788687900.742041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788687900.742045:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788687900.742046:0:36:0:(import.c:65:import_set_state_nolock()) ffff9af3fc393000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788687900.742050:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:3.0:1788687900.742053:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788687900.742056:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9af3fc393000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788687900.742067:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3fc1c7480 x1875574839665920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788687900.742105:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839665792:0@lo:8:kworker.0 00000400:00000100:3.0:1788687900.742175:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875574839665792 offset 0 length 520: 4 00000100:00100000:3.0:1788687900.742233:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839665920:0@lo:8:kworker.0 00000400:00000100:3.0:1788687900.742257:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875574839665920 offset 0 length 520: 4 00000100:00100000:1.0:1788687900.742358:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839666048:0@lo:400:kworker.0 00000100:00100000:1.0:1788687900.742419:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687900.742447:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687900.742453:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77fc0cc6-2d57-47be-a26d-d352055b72d6:3311:1875574839665664:0@lo:400:kworker.0 00000100:00100000:1.0:1788687900.742511:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687900.742567:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839666048 00000100:00100000:1.0:1788687900.742577:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839666048 00000100:00100000:1.0:1788687900.742641:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788687900.742652:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839666048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687900.742713:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839666048:12345-0@lo:400:kworker.0 Request processed in 63us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687900.742722:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788687900.742748:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839665664 00000100:00100000:1.0:1788687900.742751:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839665664 00000100:00100000:1.0:1788687900.742780:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788687900.742788:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:3311:x1875574839665664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687900.742853:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:3311:x1875574839665664:12345-0@lo:400:kworker.0 Request processed in 66us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687900.742860:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788687900.742924:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77fc0cc6-2d57-47be-a26d-d352055b72d6:3311:1875574839665664:0@lo:400:kworker.0 00010000:00080000:1.0:1788687900.742938:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9af3fc1c4e00 x1875574839666048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687900.742950:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839666048:0@lo:400:kworker.0 00010000:00010000:3.0:1788687901.510086:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788687902.288268:0:15157:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788687902.288272:0:15157:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788687902.288502:0:15157:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9af3c729e000 00000020:01000004:1.0:1788687902.288518:0:15157:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788687902.288530:0:15157:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788687902.288543:0:15157:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9af3f38bb380) 00000020:00000080:1.0:1788687902.288560:0:15157:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788687902.312694:0:15157:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788687902.312962:0:15157:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788687902.313712:0:15157:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788687902.313970:0:15157:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788687902.314171:0:15157:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788687902.315272:0:15157:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1788687902.315421:0:15157:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:0.0:1788687902.315932:0:15157:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:0.0:1788687902.316930:0:15157:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 292: rc = 0 00100000:10000000:0.0:1788687902.317249:0:15157:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 292: rc = 0 00100000:10000000:0.0:1788687902.317949:0:15157:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 292: rc = 0 00100000:10000000:0.0:1788687902.318220:0:15157:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 292: rc = 0 00100000:10000000:0.0:1788687902.318919:0:15157:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 292: rc = 0 00100000:10000000:0.0:1788687902.319581:0:15157:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 292: rc = 0 00000020:00000080:0.0:1788687902.320818:0:15157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788687902.320830:0:15157:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788687902.320843:0:15157:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc2ddd83e74449e54 00000020:01000004:0.0:1788687902.320851:0:15157:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788687902.320887:0:15157:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788687902.320891:0:15157:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788687902.320898:0:15157:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788687902.320903:0:15157:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788687902.320914:0:15157:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9af3c5b48000) 00000020:00000080:0.0:1788687902.320925:0:15157:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788687902.322219:0:15157:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788687902.322398:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788687902.322405:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788687902.326786:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788687902.326803:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788687902.330224:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788687902.330239:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788687902.332110:0:15157:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788687902.332300:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788687902.332306:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788687902.332901:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788687902.332909:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788687902.353367:0:15157:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788687902.354167:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788687902.354175:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788687902.356767:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788687902.356789:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788687902.357833:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788687902.357843:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788687902.360907:0:15157:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788687902.361098:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788687902.361299:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788687902.362170:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788687902.362179:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788687902.402569:0:15157:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788687902.402882:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788687902.402889:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788687902.404100:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788687902.404111:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788687902.404531:0:15157:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788687902.404555:0:15157:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788687902.404562:0:15157:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788687902.417135:0:15157:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788687902.417174:0:15157:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788687902.417179:0:15157:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788687902.417181:0:15157:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788687902.417182:0:15157:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788687902.417183:0:15157:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788687902.417185:0:15157:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788687902.417186:0:15157:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788687902.417187:0:15157:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788687902.417189:0:15157:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788687902.417190:0:15157:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788687902.417193:0:15157:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788687902.417195:0:15157:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788687902.417197:0:15157:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788687902.417198:0:15157:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788687902.417202:0:15157:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788687902.417203:0:15157:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788687902.417205:0:15157:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788687902.417206:0:15157:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788687902.417207:0:15157:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788687902.417208:0:15157:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788687902.417242:0:15157:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788687902.417261:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788687902.417332:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687902.417403:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f3d769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687902.420802:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839666176 00000100:00100000:1.0:1788687902.420819:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839666176 00000100:00100000:1.0:1788687902.420901:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788687902.420913:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:15157:x1875574839666176:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788687902.420985:0:14469:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788687902.420989:0:14469:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788687902.420993:0:14469:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788687902.443824:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:15157:x1875574839666176:12345-0@lo:253:mount.lustre.0 Request processed in 22902us (26481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687902.443838:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788687902.444102:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788687902.444122:0:15157:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788687902.444126:0:15157:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788687902.444128:0:15157:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788687902.444129:0:15157:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788687902.444131:0:15157:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788687902.444132:0:15157:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788687902.444133:0:15157:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788687902.444135:0:15157:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788687902.444137:0:15157:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788687902.444138:0:15157:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788687902.444162:0:15157:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9af3c729e000 from lustre-OST0000 10000000:01000000:2.0:1788687902.444192:0:15157:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788687902.444196:0:15157:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788687902.444203:0:15157:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9af3c2ebb380 local copy 00010000:00010000:2.0:1788687902.444215:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d51 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687902.444641:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788687902.444685:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687902.444797:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f159e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788687902.444951:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839666304 00000100:00100000:3.0:1788687902.444957:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839666304 00000100:00100000:3.0:1788687902.445004:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788687902.445014:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:15157:x1875574839666304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788687902.445437:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:15157:x1875574839666304:12345-0@lo:501:mount.lustre.0 Request processed in 423us (750us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788687902.445446:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788687902.448512:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666304:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788687902.450052:0:15157:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788687902.450344:0:15157:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788687902.450358:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d51 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687902.450683:0:15157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d51 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687902.450781:0:15157:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9af3c729e000 10000000:01000000:1.0:1788687902.450788:0:15157:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788687902.450793:0:15157:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9af3c2ebb380 10000000:01000000:1.0:1788687902.450796:0:15157:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788687902.450800:0:15157:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9af3c2ebb380 from 1 10000000:01000000:1.0:1788687902.450803:0:15157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788687902.450843:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc200/0xc2ddd83e74449e62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687902.450853:0:15157:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc200/0xc2ddd83e74449e62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687902.450944:0:15157:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc200/0xc2ddd83e74449e62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687902.450971:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788687902.451049:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687902.451167:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c85703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687902.451223:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839666432 00000100:00100000:2.0:1788687902.451231:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839666432 00000100:00100000:2.0:1788687902.451328:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788687902.451339:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+12:15157:x1875574839666432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788687902.451354:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687902.451377:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f15d2200/0xc2ddd83e74449e69 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449e62 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687902.451413:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f15d2200/0xc2ddd83e74449e69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449e62 expref: 13 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687902.451423:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f15d2200/0xc2ddd83e74449e69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449e62 expref: 13 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687902.451433:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2200, rc 0) 00000100:00100000:3.0:1788687902.451645:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788687902.451671:0:15157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc200/0xc2ddd83e74449e62 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e69 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.451680:0:15157:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc200/0xc2ddd83e74449e62 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449e69 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687902.452152:0:15157:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788687902.452211:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc200/0xc2ddd83e74449e62 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e69 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.452221:0:15157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc200/0xc2ddd83e74449e62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e69 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687902.452230:0:15157:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788687902.452237:0:15157:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788687902.452245:0:15157:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788687902.452248:0:15157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788687902.452276:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74449e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.452284:0:15157:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74449e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.452292:0:15157:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74449e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687902.452312:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788687902.452369:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687902.452413:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c623e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687902.452522:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839666560 00000100:00100000:0.0:1788687902.452529:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839666560 00000100:00100000:0.0:1788687902.452571:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788687902.452580:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839666560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788687902.452588:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687902.452600:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f79ec600/0xc2ddd83e74449e77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449e70 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687902.452618:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f79ec600/0xc2ddd83e74449e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449e70 expref: 15 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687902.452627:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f79ec600/0xc2ddd83e74449e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449e70 expref: 15 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687902.452634:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec600, rc 0) 00000100:00100000:0.0:1788687902.452667:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839666560:12345-0@lo:101:mount.lustre.0 Request processed in 89us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687902.452674:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788687902.452899:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839666432:12345-0@lo:101:mount.lustre.0 Request processed in 1562us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687902.452906:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788687902.453082:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788687902.453095:0:15157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74449e70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e77 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.453104:0:15157:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74449e70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449e77 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788687902.454120:0:15157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788687902.459415:0:15157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788687902.459725:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788687902.459768:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788687902.459794:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788687902.459833:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788687902.459874:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788687902.459904:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788687902.459958:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788687902.459965:0:15157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788687902.460168:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788687902.460244:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687902.460293:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c623e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788687902.460388:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839666688 00000100:00100000:0.0:1788687902.460397:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839666688 00000100:00100000:0.0:1788687902.460450:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788687902.460466:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839666688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788687902.460820:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839666688:12345-0@lo:501:mount.lustre.0 Request processed in 354us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687902.460828:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788687902.461001:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788687902.461033:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788687902.461067:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687902.461088:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c623e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788687902.461380:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839666816 00000100:00100000:2.0:1788687902.461393:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839666816 00000100:00100000:2.0:1788687902.461430:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788687902.461438:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839666816:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788687902.462158:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839666816:12345-0@lo:503:mount.lustre.0 Request processed in 717us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687902.462168:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788687902.462569:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666816:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788687902.463440:0:15157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788687902.463565:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788687902.463637:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687902.463818:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c623e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788687902.463934:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839666944 00000100:00100000:0.0:1788687902.463941:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839666944 00000100:00100000:0.0:1788687902.464022:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788687902.464033:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839666944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788687902.464284:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839666944:12345-0@lo:502:mount.lustre.0 Request processed in 252us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687902.464291:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788687902.464399:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839666944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788687902.464647:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788687902.464715:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788687902.464757:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788687902.464797:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788687902.464826:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788687902.464850:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788687902.464905:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788687902.464934:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788687902.464958:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788687902.464994:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788687902.465022:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788687902.465072:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788687902.465102:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788687902.465139:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687902.465804:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8570b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687902.465905:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839667072 00000100:00100000:3.0:1788687902.465912:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839667072 00000100:00100000:3.0:1788687902.465948:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788687902.465958:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839667072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788687902.466159:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839667072:12345-0@lo:502:mount.lustre.0 Request processed in 201us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687902.466167:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788687902.466259:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788687902.466350:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788687902.466373:0:15157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788687902.467510:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788687902.467520:0:15172:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788687902.467526:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687902.467529:0:15172:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788687902.467534:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788687902.467549:0:15172:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9af3f38b99c0) 00000020:00000080:1.0:1788687902.467571:0:15172:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788687902.467577:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788687902.467660:0:15172:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af3c729e000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788687902.467667:0:15172:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788687902.467673:0:15172:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc2ddd83e74449e85 00010000:00010000:1.0:1788687902.475255:0:15172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788687902.481086:0:15172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788687902.485248:0:15172:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788687902.488679:0:15172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788687902.488805:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687902.488813:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687902.488815:0:15172:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788687902.488818:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788687902.488821:0:15172:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788687902.488823:0:15172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788687902.488825:0:15172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788687902.488826:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788687902.488828:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687902.488829:0:15172:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788687902.488832:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687902.488834:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687902.488844:0:15172:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788687902.488848:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788687902.488850:0:15172:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788687902.488852:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687902.488854:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687902.488855:0:15172:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788687902.488869:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788687902.488871:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687902.488873:0:15172:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788687902.488889:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788687902.488970:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788687902.488973:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788687902.488974:0:15172:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788687902.488978:0:15172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788687902.489311:0:15157:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788687902.489337:0:15157:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788687902.489414:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74449e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e77 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687902.489428:0:15157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad800/0xc2ddd83e74449e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e77 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687902.489438:0:15157:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3c729e000 from 1 10000000:01000000:1.0:1788687902.489441:0:15157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687902.489498:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687902.489507:0:15157:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687902.489518:0:15157:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687902.489545:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788687902.489612:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687902.489647:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8570d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788687902.489823:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839667200 00000100:00100000:0.0:1788687902.489831:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839667200 00000100:00100000:0.0:1788687902.490044:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788687902.490055:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+14:15157:x1875574839667200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788687902.490068:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687902.490081:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449e8c expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687902.490104:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449e8c expref: 15 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687902.490114:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449e8c expref: 15 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687902.490122:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec400, rc 0) 00000100:00100000:0.0:1788687902.490165:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839667200:12345-0@lo:101:mount.lustre.0 Request processed in 112us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687902.490185:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788687902.490444:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788687902.490459:0:15157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687902.490474:0:15157:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788687902.492006:0:15157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788687902.493521:0:15157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788687902.498585:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788687902.498771:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788687902.498890:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788687902.498899:0:15157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788687902.499213:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788687902.499415:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687902.499471:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c95fd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788687902.500787:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839667328 00000100:00100000:3.0:1788687902.500799:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839667328 00000100:00100000:3.0:1788687902.500854:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788687902.500882:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839667328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788687902.501193:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839667328:12345-0@lo:501:mount.lustre.0 Request processed in 314us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687902.501202:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788687902.501244:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687902.501301:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788687902.504337:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687902.504405:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8570e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788687902.504444:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839667456 00000100:00100000:1.0:1788687902.504452:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839667456 00000100:00100000:1.0:1788687902.504647:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788687902.504658:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839667456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788687902.504900:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839667456:12345-0@lo:503:mount.lustre.0 Request processed in 244us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687902.504908:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788687902.504990:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667456:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788687902.505940:0:15157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788687902.506026:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788687902.506085:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687902.506373:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8d2d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788687902.506459:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839667584 00000100:00100000:0.0:1788687902.506465:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839667584 00000100:00100000:0.0:1788687902.506516:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788687902.506524:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839667584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788687902.506699:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839667584:12345-0@lo:502:mount.lustre.0 Request processed in 174us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687902.506707:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788687902.506845:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788687902.507087:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788687902.507129:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788687902.507167:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788687902.507196:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788687902.507222:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788687902.507258:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788687902.507297:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788687902.507324:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788687902.507351:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788687902.507388:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687902.507408:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8d2d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788687902.507476:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839667712 00000100:00100000:0.0:1788687902.507498:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839667712 00000100:00100000:0.0:1788687902.507520:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788687902.507526:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839667712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788687902.507652:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839667712:12345-0@lo:502:mount.lustre.0 Request processed in 126us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687902.507659:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788687902.507983:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788687902.508068:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788687902.508078:0:15157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788687902.509447:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788687902.509461:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788687902.509464:0:15176:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788687902.509471:0:15176:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af3c729e000 00000020:00000080:1.0:1788687902.509474:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788687902.509654:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687902.509755:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687902.509758:0:15176:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788687902.509764:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687902.509768:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687902.509770:0:15176:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788687902.509782:0:15176:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af3c729e000 00000020:00000080:0.0:1788687902.509784:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788687902.509895:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687902.509900:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687902.509901:0:15176:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788687902.509904:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687902.509907:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687902.509908:0:15176:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788687902.509912:0:15176:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9af3c729e000 00000020:00000080:0.0:1788687902.509914:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788687902.512140:0:15176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687902.512154:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687902.512156:0:15176:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788687902.512162:0:15176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788687902.512330:0:15157:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788687902.512354:0:15157:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788687902.512370:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.512381:0:15157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687902.512431:0:15157:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788687902.512433:0:15157:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9af3c729e000 10000000:01000000:3.0:1788687902.512436:0:15157:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9af3c729e000 10000000:01000000:3.0:1788687902.512439:0:15157:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788687902.512444:0:15157:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3c729e000 from 1 10000000:01000000:3.0:1788687902.512447:0:15157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788687902.512509:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74449e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.512517:0:15157:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74449e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.512543:0:15157:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74449e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687902.512570:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788687902.512642:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687902.512694:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c623e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788687902.512819:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839667840 00000100:00100000:0.0:1788687902.512827:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839667840 00000100:00100000:0.0:1788687902.512888:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788687902.512900:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839667840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788687902.512914:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687902.512926:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f79ec200/0xc2ddd83e74449ea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449e9a expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687902.512949:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f79ec200/0xc2ddd83e74449ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449e9a expref: 16 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687902.512960:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f79ec200/0xc2ddd83e74449ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449e9a expref: 16 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687902.512969:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec200, rc 0) 00000100:00100000:0.0:1788687902.513010:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15157:x1875574839667840:12345-0@lo:101:mount.lustre.0 Request processed in 113us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687902.513026:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788687902.513202:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788687902.513216:0:15157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74449e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449ea1 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.513225:0:15157:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74449e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449ea1 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788687902.513934:0:15157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788687902.514232:0:15157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788687902.514555:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788687902.514603:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788687902.514637:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788687902.515175:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788687902.515224:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788687902.515291:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788687902.515331:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788687902.515367:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788687902.515417:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788687902.515456:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788687902.523734:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788687902.523896:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788687902.523939:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788687902.523973:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788687902.524022:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788687902.524054:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788687902.524083:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788687902.524130:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788687902.524168:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788687902.524199:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788687902.524247:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788687902.524284:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788687902.524332:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788687902.524386:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788687902.524441:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788687902.525638:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788687902.525782:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788687902.525823:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788687902.525932:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788687902.525941:0:15157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788687902.526054:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788687902.526120:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687902.528628:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8d2d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788687902.531257:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839667968 00000100:00100000:1.0:1788687902.531272:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839667968 00000100:00100000:1.0:1788687902.531347:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788687902.531356:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15157:x1875574839667968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687902.531992:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15157:x1875574839667968:12345-0@lo:501:mount.lustre.0 Request processed in 636us (5870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687902.532010:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788687902.532012:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839667968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788687902.532063:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839668096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788687902.532110:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687902.532136:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8d2d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788687902.532589:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839668096 00000100:00100000:1.0:1788687902.532596:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839668096 00000100:00100000:1.0:1788687902.532628:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788687902.532637:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15157:x1875574839668096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788687902.532885:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15157:x1875574839668096:12345-0@lo:503:mount.lustre.0 Request processed in 248us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687902.532892:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:1.0:1788687902.534366:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687902.534382:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839668096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788687902.535563:0:15157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788687902.535653:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839668224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788687902.535803:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687902.535848:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8d2d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788687902.535907:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839668224 00000100:00100000:1.0:1788687902.535914:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839668224 00000100:00100000:1.0:1788687902.535996:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788687902.536005:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15157:x1875574839668224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788687902.536214:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15157:x1875574839668224:12345-0@lo:502:mount.lustre.0 Request processed in 210us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687902.536231:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788687902.536308:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839668224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788687902.536566:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788687902.536621:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788687902.536656:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788687902.536732:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788687902.536773:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788687902.536822:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788687902.536870:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788687902.536910:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788687902.536973:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788687902.537009:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788687902.537052:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788687902.537092:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788687902.537121:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788687902.537149:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788687902.537215:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788687902.537253:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788687902.537284:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788687902.537329:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788687902.537364:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788687902.537398:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788687902.537446:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788687902.537520:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788687902.537560:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788687902.537611:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788687902.537649:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788687902.537683:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788687902.537747:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788687902.537784:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788687902.537830:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788687902.537898:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788687902.537935:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788687902.537968:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788687902.538001:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788687902.538050:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788687902.538086:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788687902.538137:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788687902.538174:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788687902.538209:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788687902.538260:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788687902.538298:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788687902.538344:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839668352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788687902.538411:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687902.541646:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839668352 00000100:00100000:3.0:1788687902.541661:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839668352 00000100:00100000:3.0:1788687902.541780:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788687902.541791:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15157:x1875574839668352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788687902.541935:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5ad63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687902.542267:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15157:x1875574839668352:12345-0@lo:502:mount.lustre.0 Request processed in 477us (3856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687902.542276:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788687902.542359:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839668352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788687902.542476:0:15157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788687902.542569:0:15157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788687902.543687:0:15181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788687902.543781:0:15181:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9af3d63d99c0) 00000020:00000080:2.0:1788687902.543802:0:15181:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788687902.543882:0:15181:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af3c729e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788687902.543891:0:15181:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af3c729e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788687902.543893:0:15181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3c729e000 3 00010000:00080000:2.0:1788687902.543924:0:15181:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af3c2fa2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1788687902.546086:0:15181:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788687902.546274:0:15181:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788687902.546307:0:15181:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788687902.546318:0:15181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc2ddd83e74449eaf 00000100:00080000:2.0:1788687902.546328:0:15181:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788687902.546334:0:15181:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9af3c2fa2000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788687902.546368:0:15181:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af2c2a83100 x1875574839668480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788687902.546438:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875574839668480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788687902.546519:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788687902.546616:0:15181:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788687902.546634:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788687902.546639:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788687902.546642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788687902.546644:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788687902.546791:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839668480 00000100:00100000:3.0:1788687902.546799:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839668480 00000100:00100000:3.0:1788687902.546831:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788687902.546838:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875574839668480:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788687902.546933:0:14476:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:3.0:1788687902.546964:0:14476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc2ddd83e74449eb6 00000004:00100000:3.0:1788687902.546979:0:14476:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788687902.547011:0:14476:0:(import.c:65:import_set_state_nolock()) ffff9af3f7b70000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788687902.547434:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875574839668480:12345-0@lo:38:llog_process_th.0 Request processed in 593us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687902.547443:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788687902.547474:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839668608:0@lo:400:kworker.0 00000100:00100000:3.0:1788687902.547524:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687902.547658:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839668608 00000100:00100000:3.0:1788687902.547663:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839668608 00000100:00100000:3.0:1788687902.547692:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687902.547712:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839668608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687902.547755:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839668608:12345-0@lo:400:kworker.0 Request processed in 44us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687902.547761:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788687902.547803:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af2c2a81500 x1875574839668608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788687902.547816:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839668608:0@lo:400:kworker.0 00010000:00080000:2.0:1788687902.550441:0:3309:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af2c2a83100 x1875574839668480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788687912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687902.550456:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788687902.550468:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000040:00080000:1.0:1788687902.550765:0:15181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:2.0:1788687902.551265:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788687902.551273:0:3309:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788687902.551278:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3c2fa2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788687902.551287:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875574839668480:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788687902.551320:0:15157:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788687902.551357:0:15157:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788687902.551976:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74449e9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449ea1 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687902.551988:0:15157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aade00/0xc2ddd83e74449e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449ea1 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788687902.552043:0:15157:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788687902.552045:0:15157:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788687902.552047:0:15157:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788687902.552048:0:15157:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788687902.552050:0:15157:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788687902.552051:0:15157:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788687902.552052:0:15157:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788687902.552054:0:15157:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788687902.552056:0:15157:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788687902.552059:0:15157:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788687902.552062:0:15157:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788687902.552063:0:15157:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788687902.552064:0:15157:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788687902.552065:0:15157:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788687902.552066:0:15157:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788687902.552067:0:15157:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788687902.552068:0:15157:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788687902.552069:0:15157:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788687902.552070:0:15157:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788687902.552108:0:15157:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788687902.552127:0:15157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839668736:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788687902.552198:0:15157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687902.552242:0:15157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8d2d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788687902.552422:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839668736 00000100:00100000:1.0:1788687902.552429:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839668736 00000100:00100000:1.0:1788687902.552503:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788687902.552513:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15157:x1875574839668736:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788687902.552541:0:14471:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788687902.552557:0:14471:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788687902.621930:0:14471:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788687902.621952:0:14471:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788687902.621983:0:14492:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788687902.621989:0:14492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788687902.622010:0:14492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.622029:0:14492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3f15d2000/0xc2ddd83e74449e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449e23 expref: 16 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.622038:0:14492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.622078:0:14492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3f15d2000/0xc2ddd83e74449e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74449e23 expref: 16 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.622092:0:14492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3f15d2000/0xc2ddd83e74449e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74449e23 expref: 16 pid: 14470 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687902.622108:0:14492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14492:1875574839668864:0@lo:104: 00000100:00100000:3.0:1788687902.622175:0:14492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687902.622247:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839668864 00000100:00100000:3.0:1788687902.622248:0:14492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c623e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788687902.622256:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839668864 00000100:00100000:1.0:1788687902.622327:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788687902.622335:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77fc0cc6-2d57-47be-a26d-d352055b72d6+3:14492:x1875574839668864:12345-0@lo:104: 00010000:00010000:1.0:1788687902.622347:0:14460:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687902.622394:0:14460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788687902.622400:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77fc0cc6-2d57-47be-a26d-d352055b72d6+3:14492:x1875574839668864:12345-0@lo:104: Request processed in 67us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687902.622407:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788687902.622509:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687902.622516:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.622524:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:3.0:1788687902.622528:0:14465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.622548:0:14465:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788687902.622556:0:14465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687902.622562:0:14465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788687902.622595:0:14465:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.622602:0:14465:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788687902.622621:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.622628:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3e0aad400/0xc2ddd83e74449e23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449e2a expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.622644:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687902.622647:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687902.622648:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687902.622660:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839668992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788687902.622692:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687902.622739:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839668992 00000100:00100000:3.0:1788687902.622743:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839668992 00010000:00010000:3.0:1788687902.622762:0:14463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3f15d2000/0xc2ddd83e74449e2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449e23 expref: 17 pid: 14470 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687902.622783:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788687902.622790:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:3313:x1875574839668992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687902.622807:0:14463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687902.623361:0:14463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3f15d2000/0xc2ddd83e74449e2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449e23 expref: 17 pid: 14470 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623373:0:14463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3f15d2000/0xc2ddd83e74449e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74449e23 expref: 17 pid: 14470 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623389:0:14463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623397:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788687902.623412:0:14463:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001423867s 00010000:00010000:3.0:1788687902.623417:0:14463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623424:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623431:0:14463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623438:0:14463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623444:0:14463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac600 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687902.623448:0:14463:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623455:0:14463:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623472:0:14463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623518:0:14463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687902.623610:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:3313:x1875574839668992:12345-0@lo:103:ldlm_bl.0 Request processed in 820us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687902.623618:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788687902.623676:0:14492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f15d2000/0xc2ddd83e74449e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74449e23 expref: 16 pid: 14470 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687902.623686:0:14492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14492:1875574839668864:0@lo:104: 00010000:00010000:3.0:1788687902.623706:0:14492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623714:0:14492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623720:0:14492:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687902.623727:0:14492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aac600/0xc2ddd83e74449ebd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687902.625461:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839668992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687902.648423:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:15157:x1875574839668736:12345-0@lo:253:mount.lustre.0 Request processed in 95901us (96214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687902.648439:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788687902.648562:0:15157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15157:1875574839668736:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788687902.648578:0:15157:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788687902.648581:0:15157:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788687902.648583:0:15157:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788687902.648600:0:15157:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788687902.648602:0:15157:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788687902.648603:0:15157:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788687902.648604:0:15157:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788687902.648606:0:15157:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788687902.648607:0:15157:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788687902.648609:0:15157:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788687902.648627:0:15157:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788687902.654631:0:15157:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687902.654779:0:15157:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687902.654953:0:15157:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687902.655104:0:15157:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788687902.655252:0:15157:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788687902.655468:0:15157:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788687902.656460:0:15157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788687902.727210:0:15157:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788687902.727217:0:15157:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788687902.727256:0:15157:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788687902.727324:0:15157:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788687902.727338:0:15157:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788687902.727380:0:15157:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:1.0:1788687902.804788:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788687903.560977:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788687904.519733:0:14473:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788687904.519745:0:14473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af2c1b98800 from 7 10000000:01000000:1.0:1788687904.519751:0:14473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788687904.519812:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687904.519839:0:14473:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687904.519853:0:14473:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687904.519890:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839669120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788687904.519991:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687904.520066:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c831b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687904.520259:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839669120 00000100:00100000:2.0:1788687904.520270:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839669120 00000100:00100000:2.0:1788687904.520353:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788687904.520365:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+15:14473:x1875574839669120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687904.520384:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687904.520403:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f15d2a00/0xc2ddd83e74449ecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449ec4 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687904.520432:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f15d2a00/0xc2ddd83e74449ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449ec4 expref: 16 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687904.520446:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f15d2a00/0xc2ddd83e74449ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449ec4 expref: 16 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687904.520456:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2a00, rc 0) 00000100:00100000:2.0:1788687904.520543:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:14473:x1875574839669120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687904.520568:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788687904.520845:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839669120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687904.520876:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687904.520889:0:14473:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687904.520964:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839669248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788687904.521009:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687904.521044:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c831b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687904.521097:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839669248 00000100:00100000:2.0:1788687904.521104:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839669248 00000100:00100000:2.0:1788687904.521138:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788687904.521147:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:14473:x1875574839669248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788687904.521166:0:14471:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788687904.521187:0:14471:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788687904.521191:0:14471:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788687904.521282:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:14473:x1875574839669248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687904.521290:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788687904.521415:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839669248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788687904.521515:0:14473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788687904.521525:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687904.521535:0:14473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687904.582671:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687905.606321:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687906.631209:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687907.656894:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788687907.789312:0:15525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788687907.911856:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788687907.911864:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788687907.911867:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788687907.911870:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788687907.911929:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839669504:0@lo:400:kworker.0 00000100:00100000:0.0:1788687907.912106:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687907.912113:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839669376:0@lo:400:kworker.0 00000100:00100000:3.0:1788687907.912154:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687907.912182:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839669632:0@lo:400:kworker.0 00000100:00100000:0.0:1788687907.912230:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687907.912260:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839669376 00000100:00100000:0.0:1788687907.912267:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839669504 00000100:00100000:0.0:1788687907.912278:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839669504 00000100:00100000:0.0:1788687907.912319:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839669632 00000100:00100000:0.0:1788687907.912322:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839669632 00000100:00100000:3.0:1788687907.912330:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839669376 00000100:00100000:0.0:1788687907.912352:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788687907.912356:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788687907.912360:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839669504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687907.912361:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:3310:x1875574839669376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687907.912405:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:3310:x1875574839669376:12345-0@lo:400:kworker.0 Request processed in 42us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687907.912405:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839669504:12345-0@lo:400:kworker.0 Request processed in 45us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687907.912413:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788687907.912413:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788687907.912428:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788687907.912434:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839669632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687907.912457:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839669376:0@lo:400:kworker.0 00000100:00100000:0.0:1788687907.912461:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839669632:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687907.912466:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788687907.912623:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788687907.913380:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c697d880 x1875574839669632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687907.913399:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839669632:0@lo:400:kworker.0 00010000:00080000:0.0:1788687907.916093:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c697f800 x1875574839669504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687907.916111:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839669504:0@lo:400:kworker.0 00010000:00010000:3.0:1788687908.680135:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687909.714343:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687910.726425:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687911.749648:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788687912.009547:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788687912.774326:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788687913.031314:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788687913.031321:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788687913.031324:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788687913.031327:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788687913.031388:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839669760:0@lo:400:kworker.0 00000100:00100000:1.0:1788687913.031461:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687913.031549:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839670016:0@lo:400:kworker.0 00000100:00100000:1.0:1788687913.031941:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687913.031975:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788687913.031983:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839669888:0@lo:400:kworker.0 00000100:00100000:1.0:1788687913.032013:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687913.032053:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839669760 00000100:00100000:1.0:1788687913.032062:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839669760 00000100:00100000:1.0:1788687913.032115:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788687913.032126:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:3313:x1875574839669760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687913.032853:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:3313:x1875574839669760:12345-0@lo:400:kworker.0 Request processed in 727us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687913.032863:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788687913.032901:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839670016 00000100:00100000:1.0:1788687913.032906:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839670016 00000100:00100000:1.0:1788687913.032943:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839669888 00000100:00100000:1.0:1788687913.032947:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839669888 00000100:00100000:1.0:1788687913.032962:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788687913.032968:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839670016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687913.033029:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839669760:0@lo:400:kworker.0 00000100:00100000:1.0:1788687913.033066:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839670016:12345-0@lo:400:kworker.0 Request processed in 96us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687913.033073:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788687913.033086:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788687913.033093:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839669888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687913.033121:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839669888:12345-0@lo:400:kworker.0 Request processed in 29us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687913.033127:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788687913.033145:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788687913.034535:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3ffe3b800 x1875574839669888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687913.034554:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839669888:0@lo:400:kworker.0 00010000:00080000:1.0:1788687913.034567:0:3311:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3ffe39500 x1875574839670016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687913.035413:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839670016:0@lo:400:kworker.0 00010000:00010000:3.0:1788687913.799368:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788687914.480401:0:15874:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788687914.480406:0:15874:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788687914.480570:0:15874:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9af3c6a19800 00000020:01000004:1.0:1788687914.480587:0:15874:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788687914.480600:0:15874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788687914.480613:0:15874:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9af3f38b8000) 00000020:00000080:1.0:1788687914.480878:0:15874:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788687914.499214:0:15874:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788687914.499571:0:15874:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788687914.500779:0:15874:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788687914.501103:0:15874:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788687914.501426:0:15874:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788687914.503214:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 311: rc = 0 00100000:10000000:1.0:1788687914.503366:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 311: rc = 0 00100000:10000000:1.0:1788687914.503462:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 311: rc = 0 00100000:10000000:1.0:1788687914.504320:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 480: rc = 0 00100000:10000000:1.0:1788687914.504870:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 480: rc = 0 00100000:10000000:1.0:1788687914.505205:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 480: rc = 0 00100000:10000000:1.0:1788687914.505452:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 480: rc = 0 00100000:10000000:0.0:1788687914.506073:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 480: rc = 0 00100000:10000000:0.0:1788687914.506416:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 480: rc = 0 00000020:00000080:0.0:1788687914.507281:0:15874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788687914.507293:0:15874:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788687914.507306:0:15874:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc2ddd83e74449ed9 00000020:01000004:0.0:1788687914.507315:0:15874:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788687914.507344:0:15874:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788687914.507348:0:15874:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788687914.507354:0:15874:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788687914.507377:0:15874:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788687914.507382:0:15874:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788687914.522751:0:15874:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788687914.522865:0:15874:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.126@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788687914.522870:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788687914.522873:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788687914.522874:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687914.522875:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687914.522876:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687914.522877:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687914.522878:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788687914.522880:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687914.522881:0:15874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788687914.522885:0:15874:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788687914.522887:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788687914.522889:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788687914.522890:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687914.522891:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687914.522892:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687914.522893:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687914.522894:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788687914.522895:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687914.522896:0:15874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788687914.522923:0:15874:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788687914.522947:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670144:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788687914.523031:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687914.523187:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687914.523338:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839670144 00000100:00100000:3.0:1788687914.523348:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839670144 00000100:00100000:3.0:1788687914.523460:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788687914.523470:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15874:x1875574839670144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788687914.523534:0:14471:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788687914.523538:0:14471:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788687914.523542:0:14471:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788687914.532616:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15874:x1875574839670144:12345-0@lo:253:mount.lustre.0 Request processed in 9135us (9571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687914.532726:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788687914.532954:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670144:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788687914.532972:0:15874:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788687914.532976:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788687914.532978:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788687914.532995:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687914.532996:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687914.532997:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687914.532999:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687914.533001:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788687914.533002:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687914.533004:0:15874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788687914.533024:0:15874:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9af3c6a19800 from lustre-OST0001 10000000:01000000:0.0:1788687914.533053:0:15874:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788687914.533056:0:15874:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788687914.533064:0:15874:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9af3c2ebb380 local copy 00010000:00010000:0.0:1788687914.533075:0:15874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d51 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687914.533333:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788687914.533378:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687914.533422:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788687914.533553:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839670272 00000100:00100000:3.0:1788687914.533560:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839670272 00000100:00100000:3.0:1788687914.533604:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788687914.533613:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15874:x1875574839670272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788687914.533797:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15874:x1875574839670272:12345-0@lo:501:mount.lustre.0 Request processed in 173us (407us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788687914.533804:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788687914.533968:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670272:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788687914.533980:0:15874:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788687914.534118:0:15874:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788687914.534191:0:15874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d51 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.534201:0:15874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cde00/0xc2ddd83e74449d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449d51 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687914.534229:0:15874:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9af3c6a19800 10000000:01000000:0.0:1788687914.534234:0:15874:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788687914.534239:0:15874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788687914.534242:0:15874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788687914.534247:0:15874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788687914.534256:0:15874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788687914.534283:0:15874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed400/0xc2ddd83e74449ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.534292:0:15874:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed400/0xc2ddd83e74449ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.534301:0:15874:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed400/0xc2ddd83e74449ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687914.534318:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788687914.534350:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687914.534374:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788687914.534441:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839670400 00000100:00100000:2.0:1788687914.534447:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839670400 00000100:00100000:2.0:1788687914.534503:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788687914.534511:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:15874:x1875574839670400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788687914.534520:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687914.534534:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f15d2c00/0xc2ddd83e74449ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449ee0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687914.534557:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f15d2c00/0xc2ddd83e74449ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449ee0 expref: 17 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687914.534580:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f15d2c00/0xc2ddd83e74449ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449ee0 expref: 17 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687914.534589:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f15d2c00, rc 0) 00000100:00100000:2.0:1788687914.534622:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:15874:x1875574839670400:12345-0@lo:101:mount.lustre.0 Request processed in 112us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687914.534643:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788687914.534745:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788687914.534758:0:15874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed400/0xc2ddd83e74449ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449ee7 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.534767:0:15874:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed400/0xc2ddd83e74449ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449ee7 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788687914.535880:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788687914.540284:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788687914.540773:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788687914.540834:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788687914.540871:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788687914.540916:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788687914.540954:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788687914.540987:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788687914.541049:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788687914.541056:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788687914.541171:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788687914.541246:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687914.541296:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687914.541519:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839670528 00000100:00100000:1.0:1788687914.541541:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839670528 00000100:00100000:1.0:1788687914.541589:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788687914.541597:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:15874:x1875574839670528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687914.541967:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:15874:x1875574839670528:12345-0@lo:501:mount.lustre.0 Request processed in 369us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687914.541975:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788687914.542249:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788687914.542292:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788687914.542339:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687914.542375:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687914.542414:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839670656 00000100:00100000:0.0:1788687914.542420:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839670656 00000100:00100000:0.0:1788687914.542456:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788687914.542465:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:15874:x1875574839670656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788687914.542888:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:15874:x1875574839670656:12345-0@lo:503:mount.lustre.0 Request processed in 423us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687914.542896:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788687914.542993:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670656:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788687914.544319:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788687914.544409:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788687914.544615:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687914.544712:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788687914.544751:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839670784 00000100:00100000:0.0:1788687914.544758:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839670784 00000100:00100000:0.0:1788687914.544922:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788687914.544933:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:15874:x1875574839670784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788687914.545300:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:15874:x1875574839670784:12345-0@lo:502:mount.lustre.0 Request processed in 367us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687914.545307:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788687914.545387:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788687914.545706:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788687914.545761:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788687914.545876:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788687914.545930:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788687914.545966:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788687914.545994:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788687914.546042:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788687914.546076:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788687914.546197:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788687914.546236:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788687914.546287:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687914.546385:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c83bf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687914.546426:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839670912 00000100:00100000:1.0:1788687914.546432:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839670912 00000100:00100000:1.0:1788687914.546597:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788687914.546608:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:15874:x1875574839670912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788687914.546825:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:15874:x1875574839670912:12345-0@lo:502:mount.lustre.0 Request processed in 219us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687914.546833:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788687914.546908:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839670912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788687914.546976:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788687914.546986:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788687914.548194:0:15875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788687914.548203:0:15875:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788687914.548210:0:15875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687914.548212:0:15875:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788687914.548218:0:15875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788687914.548233:0:15875:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9af3d63d8000) 00000020:00000080:2.0:1788687914.548259:0:15875:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788687914.548265:0:15875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788687914.548328:0:15875:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af3c6a19800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788687914.548337:0:15875:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788687914.548355:0:15875:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc2ddd83e74449ef5 00010000:00010000:2.0:1788687914.555759:0:15875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788687914.556457:0:15875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788687914.560380:0:15875:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788687914.564332:0:15875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788687914.564345:0:15875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788687914.564351:0:15875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687914.564353:0:15875:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788687914.564357:0:15875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788687914.564362:0:15875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687914.564364:0:15875:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788687914.564366:0:15875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788687914.564368:0:15875:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788687914.564370:0:15875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788687914.564373:0:15875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687914.564374:0:15875:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788687914.564377:0:15875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788687914.564379:0:15875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687914.564380:0:15875:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788687914.564384:0:15875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788687914.564465:0:15875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788687914.564469:0:15875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788687914.564471:0:15875:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788687914.564475:0:15875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788687914.567023:0:15874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788687914.567064:0:15874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788687914.567088:0:15874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed400/0xc2ddd83e74449ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449ee7 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687914.567101:0:15874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f79ed400/0xc2ddd83e74449ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449ee7 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687914.567110:0:15874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3c6a19800 from 1 10000000:01000000:1.0:1788687914.567113:0:15874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687914.567162:0:15874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687914.567170:0:15874:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687914.567193:0:15874:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687914.567219:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788687914.567290:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687914.567337:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6e4d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788687914.568145:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839671040 00000100:00100000:1.0:1788687914.568156:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839671040 00000100:00100000:1.0:1788687914.568210:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788687914.568220:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:15874:x1875574839671040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788687914.568236:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687914.568253:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74449f03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449efc expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687914.568279:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74449f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449efc expref: 18 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687914.568288:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74449f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449efc expref: 18 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687914.568297:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc400, rc 0) 00000100:00100000:1.0:1788687914.568352:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839671040:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687914.568358:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788687914.568408:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788687914.568439:0:15874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687914.568457:0:15874:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788687914.569033:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788687914.569540:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788687914.569802:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788687914.569849:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788687914.569911:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788687914.569919:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788687914.569996:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687914.570059:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687914.570117:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839671168 00000100:00100000:1.0:1788687914.570124:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839671168 00000100:00100000:1.0:1788687914.570162:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788687914.570171:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839671168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687914.570362:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839671168:12345-0@lo:501:mount.lustre.0 Request processed in 192us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687914.570369:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788687914.570414:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6e4d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788687914.570434:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687914.570465:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788687914.570535:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687914.570556:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839671296 00000100:00100000:1.0:1788687914.570560:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839671296 00000100:00100000:1.0:1788687914.570580:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788687914.570587:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839671296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788687914.570739:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839671296:12345-0@lo:503:mount.lustre.0 Request processed in 152us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687914.570745:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788687914.570775:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6e4d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788687914.570787:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671296:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788687914.576355:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788687914.584462:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788687914.584580:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687914.584648:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788687914.585027:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839671424 00000100:00100000:1.0:1788687914.585037:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839671424 00000100:00100000:1.0:1788687914.585091:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788687914.585101:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839671424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788687914.585343:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839671424:12345-0@lo:502:mount.lustre.0 Request processed in 241us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687914.585351:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788687914.585569:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788687914.585961:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788687914.586016:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788687914.586060:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788687914.586096:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788687914.587093:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788687914.587218:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788687914.587259:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788687914.587295:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788687914.587349:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788687914.587423:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687914.587477:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788687914.587874:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839671552 00000100:00100000:3.0:1788687914.587884:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839671552 00000100:00100000:3.0:1788687914.587936:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788687914.587946:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839671552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788687914.588170:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839671552:12345-0@lo:502:mount.lustre.0 Request processed in 224us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687914.588178:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788687914.589004:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788687914.589177:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788687914.589192:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788687914.590357:0:15879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687914.590368:0:15879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687914.590371:0:15879:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788687914.590378:0:15879:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af3c6a19800 00000020:00000080:0.0:1788687914.590387:0:15879:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788687914.590395:0:15879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687914.590398:0:15879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687914.590399:0:15879:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788687914.590402:0:15879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687914.590405:0:15879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687914.590406:0:15879:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788687914.590409:0:15879:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af3c6a19800 00000020:00000080:0.0:1788687914.590411:0:15879:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788687914.590601:0:15879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687914.590606:0:15879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687914.590607:0:15879:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788687914.590610:0:15879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788687914.590612:0:15879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687914.590613:0:15879:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788687914.590617:0:15879:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9af3c6a19800 00000020:00000080:0.0:1788687914.590619:0:15879:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788687914.590674:0:15879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788687914.590678:0:15879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788687914.590679:0:15879:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788687914.590683:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788687914.590872:0:15874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788687914.590897:0:15874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788687914.590917:0:15874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.590930:0:15874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788687914.590976:0:15874:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788687914.590980:0:15874:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9af3c6a19800 10000000:01000000:3.0:1788687914.590983:0:15874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9af3c6a19800 10000000:01000000:3.0:1788687914.590987:0:15874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788687914.590993:0:15874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af3c6a19800 from 1 10000000:01000000:3.0:1788687914.590996:0:15874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788687914.591036:0:15874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74449f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.591057:0:15874:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74449f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.591069:0:15874:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74449f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687914.591097:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788687914.591180:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687914.591221:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee476240 going to sleep for 11 seconds 00000100:00100000:0.0:1788687914.591331:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839671680 00000100:00100000:0.0:1788687914.591338:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839671680 00000100:00100000:0.0:1788687914.591390:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788687914.591400:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839671680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788687914.591415:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687914.591524:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f79ed000/0xc2ddd83e74449f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e74449f0a expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.591549:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f79ed000/0xc2ddd83e74449f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e74449f0a expref: 19 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.591574:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f79ed000/0xc2ddd83e74449f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449f0a expref: 19 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.591584:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed000, rc 0) 00000100:00100000:0.0:1788687914.591639:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:15874:x1875574839671680:12345-0@lo:101:mount.lustre.0 Request processed in 225us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687914.591647:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788687914.592931:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788687914.592955:0:15874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74449f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449f11 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.592966:0:15874:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74449f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e74449f11 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788687914.593679:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788687914.594074:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788687914.594320:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788687914.594363:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788687914.594405:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788687914.594443:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788687914.594472:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788687914.594563:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788687914.594599:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788687914.594651:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788687914.594714:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788687914.594752:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788687914.594792:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788687914.594835:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788687914.594864:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788687914.594892:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788687914.594934:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788687914.594962:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788687914.594988:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788687914.595030:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788687914.595078:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788687914.595108:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788687914.595151:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788687914.595187:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788687914.595220:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788687914.595269:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788687914.595305:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788687914.595349:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788687914.595407:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788687914.595440:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788687914.595466:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788687914.595530:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788687914.595560:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788687914.595585:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788687914.595610:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788687914.595668:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788687914.595712:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788687914.605099:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788687914.605236:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788687914.605348:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788687914.605357:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788687914.605508:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788687914.605583:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687914.605643:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee476240 going to sleep for 11 seconds 00000100:00100000:1.0:1788687914.607254:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839671808 00000100:00100000:1.0:1788687914.607267:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839671808 00000100:00100000:1.0:1788687914.607329:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788687914.607340:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:15874:x1875574839671808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788687914.607707:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:15874:x1875574839671808:12345-0@lo:501:mount.lustre.0 Request processed in 368us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687914.607715:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788687914.608597:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788687914.608673:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788687914.608733:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687914.608774:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee476240 going to sleep for 11 seconds 00000100:00100000:1.0:1788687914.608948:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839671936 00000100:00100000:1.0:1788687914.608954:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839671936 00000100:00100000:1.0:1788687914.608986:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788687914.608994:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:15874:x1875574839671936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788687914.609170:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:15874:x1875574839671936:12345-0@lo:503:mount.lustre.0 Request processed in 175us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687914.609185:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788687914.609702:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839671936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788687914.610257:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788687914.610336:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839672064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788687914.610390:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687914.610445:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee476240 going to sleep for 11 seconds 00000100:00100000:0.0:1788687914.610721:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839672064 00000100:00100000:0.0:1788687914.610728:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839672064 00000100:00100000:0.0:1788687914.610764:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788687914.610773:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:15874:x1875574839672064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788687914.610998:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:15874:x1875574839672064:12345-0@lo:502:mount.lustre.0 Request processed in 226us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687914.611005:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788687914.611172:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839672064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788687914.611594:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788687914.611665:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788687914.611700:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788687914.611751:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788687914.613025:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788687914.613162:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788687914.613204:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788687914.613240:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788687914.613288:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788687914.613343:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788687914.613378:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788687914.616002:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788687914.616111:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788687914.616147:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788687914.616219:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788687914.616257:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788687914.616294:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788687914.616346:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788687914.616397:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788687914.616427:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788687914.616517:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788687914.616556:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788687914.616588:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788687914.616660:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788687914.616700:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788687914.616757:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788687914.616805:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788687914.616836:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788687914.616865:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788687914.617984:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788687914.618025:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788687914.618060:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788687914.618093:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788687914.618221:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788687914.618264:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788687914.618315:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788687914.618354:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788687914.618392:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788687914.619243:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788687914.619305:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788687914.619364:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839672192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788687914.622328:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687914.624230:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839672192 00000100:00100000:3.0:1788687914.624246:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839672192 00000100:00100000:3.0:1788687914.624324:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788687914.624336:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:15874:x1875574839672192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788687914.624679:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:15874:x1875574839672192:12345-0@lo:502:mount.lustre.0 Request processed in 345us (2359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687914.624687:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788687914.624762:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee476240 going to sleep for 11 seconds 00000100:00100000:3.0:1788687914.624786:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839672192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788687914.624906:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788687914.624926:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788687914.642885:0:15884:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788687914.642905:0:15884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9af3c2fbb380) 00000020:00000080:3.0:1788687914.642931:0:15884:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788687914.643016:0:15884:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af3c6a19800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788687914.643020:0:15884:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af3c6a19800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788687914.643023:0:15884:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af3c6a19800 3 00010000:00080000:3.0:1788687914.643058:0:15884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af3f40e2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1788687914.648528:0:15884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788687914.652596:0:15884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788687914.652652:0:15884:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788687914.652755:0:15884:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc2ddd83e74449f1f 00000100:00080000:1.0:1788687914.652765:0:15884:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788687914.652772:0:15884:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9af3f40e2000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788687914.652808:0:15884:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3ffe39500 x1875574839672320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788687914.652875:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875574839672320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788687914.652950:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687914.653194:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839672320 00000100:00100000:0.0:1788687914.653204:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839672320 00000100:00100000:0.0:1788687914.653244:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788687914.653254:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1875574839672320:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788687914.653279:0:14477:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1788687914.653318:0:14477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc2ddd83e74449f26 00000004:00100000:0.0:1788687914.653334:0:14477:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788687914.653372:0:14477:0:(import.c:65:import_set_state_nolock()) ffff9af3fbbfc000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788687914.653445:0:15884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788687914.663445:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875574839672320:12345-0@lo:38:llog_process_th.0 Request processed in 10179us (10481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687914.663462:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788687914.663534:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788687914.663539:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788687914.663542:0:12639:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788687914.663545:0:12639:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788687914.663636:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839672576:0@lo:400:kworker.0 00000100:00100000:1.0:1788687914.663659:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839672448:0@lo:400:kworker.0 00000100:00100000:0.0:1788687914.663706:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788687914.663785:0:3309:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3ffe39500 x1875574839672320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788687924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687914.663797:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788687914.663809:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788687914.663819:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788687914.663831:0:3309:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788687914.663835:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f40e2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788687914.663842:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875574839672320:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788687914.663912:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839672576 00000100:00100000:1.0:1788687914.663920:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839672576 00000100:00100000:1.0:1788687914.663979:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788687914.663989:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839672576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687914.664049:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839672576:12345-0@lo:400:kworker.0 Request processed in 62us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687914.664056:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788687914.664077:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687914.664106:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839672448 00000100:00100000:1.0:1788687914.664109:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839672448 00000100:00100000:1.0:1788687914.664146:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788687914.664151:0:14478:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788687914.664156:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839672448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687914.664164:0:14478:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788687914.664212:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839672448:12345-0@lo:400:kworker.0 Request processed in 48us (122us total) trans 0 rc 0/0 00010000:00080000:0.0:1788687914.664218:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c697f800 x1875574839672448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687914.664223:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788687914.664237:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839672448:0@lo:400:kworker.0 00000040:00080000:1.0:1788687914.664402:0:15884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788687914.664636:0:15874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788687914.664665:0:15874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788687914.664685:0:15874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74449f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449f11 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.664697:0:15874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3e0aac600/0xc2ddd83e74449f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e74449f11 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788687914.664743:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788687914.664745:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788687914.664746:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687914.664747:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687914.664748:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687914.664750:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687914.664751:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788687914.664753:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687914.664754:0:15874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788687914.664758:0:15874:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788687914.664764:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788687914.664766:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788687914.664767:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687914.664768:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687914.664769:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687914.664770:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687914.664771:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788687914.664773:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687914.664774:0:15874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788687914.664791:0:15874:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00010000:00080000:2.0:1788687914.664802:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af3c697d880 x1875574839672576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687914.664806:0:15874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839672704:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788687914.664821:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839672576:0@lo:400:kworker.0 00000100:00100000:0.0:1788687914.664867:0:15874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687914.664912:0:15874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687914.664967:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839672704 00000100:00100000:1.0:1788687914.664972:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839672704 00000100:00100000:1.0:1788687914.665016:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788687914.665025:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:15874:x1875574839672704:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788687914.665048:0:14471:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788687914.665197:0:14471:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788687914.709111:0:14471:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788687914.709252:0:14471:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788687914.712227:0:14492:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788687914.712237:0:14492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788687914.712260:0:14492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.712281:0:14492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3f15d2a00/0xc2ddd83e74449ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449ec4 expref: 19 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.712290:0:14492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.712330:0:14492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3f15d2a00/0xc2ddd83e74449ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74449ec4 expref: 19 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.712346:0:14492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3f15d2a00/0xc2ddd83e74449ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74449ec4 expref: 19 pid: 14469 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687914.712361:0:14492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14492:1875574839672832:0@lo:104: 00000100:00100000:3.0:1788687914.712507:0:14492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687914.712658:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839672832 00000100:00100000:0.0:1788687914.712666:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839672832 00000100:00100000:3.0:1788687914.712677:0:14492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3ee476240 going to sleep for 11 seconds 00000100:00100000:0.0:1788687914.712715:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788687914.712720:0:14460:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788687914.712723:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+3:14492:x1875574839672832:12345-0@lo:104: 00000100:00100000:3.0:1788687914.712727:0:14460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788687914.712736:0:14459:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.712789:0:14459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788687914.712796:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+3:14492:x1875574839672832:12345-0@lo:104: Request processed in 74us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687914.712803:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788687914.712822:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687914.712828:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.712835:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd600 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:0.0:1788687914.712839:0:14465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.712856:0:14465:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788687914.712862:0:14465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788687914.712867:0:14465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788687914.712895:0:14465:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.712902:0:14465:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788687914.712923:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.712930:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd600/0xc2ddd83e74449ec4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449ecb expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687914.712931:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839672960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788687914.712945:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687914.712947:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687914.712949:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687914.712959:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687914.712988:0:14492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14492:1875574839672832:0@lo:104: 00000100:00100000:3.0:1788687914.712998:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839672960 00000100:00100000:3.0:1788687914.713001:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839672960 00010000:00010000:0.0:1788687914.713009:0:14492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713017:0:14463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3f15d2a00/0xc2ddd83e74449ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449ec4 expref: 20 pid: 14469 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687914.713051:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788687914.713058:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77fc0cc6-2d57-47be-a26d-d352055b72d6+20:3310:x1875574839672960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788687914.713069:0:14463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687914.713075:0:14463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3f15d2a00/0xc2ddd83e74449ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449ec4 expref: 20 pid: 14469 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713086:0:14463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3f15d2a00/0xc2ddd83e74449ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74449ec4 expref: 20 pid: 14469 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713101:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f15d2a00/0xc2ddd83e74449ecb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74449ec4 expref: 20 pid: 14469 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713115:0:14463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713124:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788687914.713137:0:14463:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001423867s 00010000:00010000:3.0:1788687914.713213:0:14463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713231:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713239:0:14463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713246:0:14463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713252:0:14463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687914.713262:0:14463:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713273:0:14463:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713286:0:14463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687914.713295:0:14463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687914.713326:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:3310:x1875574839672960:12345-0@lo:103:ldlm_bl.0 Request processed in 270us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687914.713334:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788687914.713362:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839672960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788687914.714219:0:14492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.714230:0:14492:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687914.714250:0:14492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aad400/0xc2ddd83e74449f2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687914.719410:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:15874:x1875574839672704:12345-0@lo:253:mount.lustre.0 Request processed in 54376us (54532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687914.719425:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788687914.719549:0:15874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77fc0cc6-2d57-47be-a26d-d352055b72d6:15874:1875574839672704:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788687914.719576:0:15874:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788687914.719580:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788687914.719582:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788687914.719583:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788687914.719585:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788687914.719586:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788687914.719587:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788687914.719589:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788687914.719590:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788687914.719592:0:15874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788687914.719607:0:15874:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788687914.728861:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788687914.729729:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788687914.729912:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788687914.730213:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788687914.730368:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788687914.730692:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788687914.731545:0:15874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788687914.774892:0:15874:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788687914.774900:0:15874:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788687914.774940:0:15874:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788687914.775002:0:15874:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788687914.775015:0:15874:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788687914.775044:0:15874:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788687914.822853:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687915.718652:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788687900/real 1788687900] req@ffff9af3fc1c6a00 x1875574839665792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788687915 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687915.718685:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9af3fc1c6a00 x1875574839665792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788687915 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687915.718695:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788687900/real 1788687900] req@ffff9af3fc1c7480 x1875574839665920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788687915 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687915.718706:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9af3fc1c7480 x1875574839665920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788687915 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788687915.718727:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f3675000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788687915.718812:0:3309:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788687915.718816:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839665792:0@lo:8:kworker.0 00000100:00080000:2.0:1788687915.718822:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3fc393000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788687915.718898:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788687915.718903:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788687915.718906:0:36:0:(import.c:65:import_set_state_nolock()) ffff9af3f3675000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788687915.718911:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1788687915.718916:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788687915.718922:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9af3f3675000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788687915.718942:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3c697c000 x1875574839673216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788687915.718963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788687915.718966:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788687915.718968:0:36:0:(import.c:65:import_set_state_nolock()) ffff9af3fc393000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788687915.718970:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1788687915.718973:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788687915.718976:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9af3fc393000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788687915.718987:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af3c697ca80 x1875574839673344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788687915.719038:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839673728:0@lo:400:kworker.0 00000100:00100000:0.0:1788687915.719103:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687915.719153:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788687915.719160:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839673088:0@lo:400:kworker.0 00000100:00100000:0.0:1788687915.719187:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687915.719216:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839673472:0@lo:400:kworker.0 00000100:00100000:0.0:1788687915.719239:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687915.719258:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788687915.719264:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839673600:0@lo:400:kworker.0 00000100:00100000:0.0:1788687915.719284:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687915.719314:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839673728 00000100:00100000:0.0:1788687915.719321:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839673728 00000100:00100000:0.0:1788687915.719372:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839673472 00000100:00100000:0.0:1788687915.719375:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839673472 00000100:00100000:0.0:1788687915.719389:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839673600 00000100:00100000:0.0:1788687915.719391:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839673600 00000100:00100000:0.0:1788687915.719421:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788687915.719430:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839673728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687915.719518:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839673728:12345-0@lo:400:kworker.0 Request processed in 89us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687915.719525:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788687915.719542:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788687915.719549:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839673472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687915.719579:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839673472:12345-0@lo:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687915.719585:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788687915.719596:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788687915.719617:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839673600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687915.719644:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875574839673600:12345-0@lo:400:kworker.0 Request processed in 42us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687915.719650:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788687915.719671:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788687915.719698:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c697d500 x1875574839673600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687915.719709:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875574839673600:0@lo:400:kworker.0 00010000:00080000:0.0:1788687915.719717:0:3312:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c697df80 x1875574839673472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687915.719724:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839673472:0@lo:400:kworker.0 00010000:00080000:0.0:1788687915.719754:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c697e300 x1875574839673728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788687915.719760:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839673728:0@lo:400:kworker.0 00000100:00100000:3.0:1788687915.720547:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839673088 00000100:00100000:3.0:1788687915.720555:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839673088 00000100:00100000:3.0:1788687915.720595:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788687915.720618:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:3310:x1875574839673088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687915.720676:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:3310:x1875574839673088:12345-0@lo:400:kworker.0 Request processed in 73us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687915.720683:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788687915.722729:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839673088:0@lo:400:kworker.0 00000100:00080000:2.0:1788687915.723111:0:3309:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788687915.723118:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fc1c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839665920:0@lo:8:kworker.0 00000100:00100000:2.0:1788687915.723142:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839673216:0@lo:8:kworker.0 00000100:00100000:2.0:1788687915.723201:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687915.723254:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839673344:0@lo:8:kworker.0 00000100:00100000:2.0:1788687915.723277:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687915.723316:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839673216 00000100:00100000:2.0:1788687915.723322:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839673216 00000100:00100000:2.0:1788687915.723344:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839673344 00000100:00100000:2.0:1788687915.723347:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839673344 00000100:00100000:2.0:1788687915.723357:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788687915.723364:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875574839673216:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788687915.723391:0:15160:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:2.0:1788687915.723514:0:15160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2ddd83e74449f34 00002000:00100000:2.0:1788687915.723529:0:15160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9af2c2104000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788687915.723534:0:15160:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788687915.723536:0:15160:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788687915.723885:0:15160:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788687915.723909:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9af2c2105000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788687915.723963:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875574839673216:12345-0@lo:8:kworker.0 Request processed in 598us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687915.723971:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788687915.723993:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788687915.723998:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875574839673344:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788687915.724013:0:15160:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:2.0:1788687915.724028:0:15160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2ddd83e74449f3b 00002000:00100000:2.0:1788687915.724035:0:15160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9af2c2101800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788687915.724038:0:15160:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788687915.724041:0:15160:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788687915.724235:0:15160:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788687915.724257:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9af2c2107800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788687915.724287:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875574839673344:12345-0@lo:8:kworker.0 Request processed in 288us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687915.724294:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788687915.724338:0:3309:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c697c000 x1875574839673216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788687935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687915.724347:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788687915.724355:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788687915.724363:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788687915.724368:0:3309:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788687915.724370:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3f3675000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788687915.724387:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788687915.724392:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839673216:0@lo:8:kworker.0 00000004:00080000:0.0:1788687915.724678:0:14498:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788687915.724956:0:14498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 461415474090ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788687915.725028:0:14499:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788687915.725047:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14499:1875574839673984:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788687915.725087:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687915.725109:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3d2925180 going to sleep for 11 seconds 00000100:00100000:0.0:1788687915.725122:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788687915.725131:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839673856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687915.725156:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788687915.725542:0:3309:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c697ca80 x1875574839673344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788687935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687915.725566:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788687915.725573:0:3309:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788687915.725579:0:3309:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788687915.725584:0:3309:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788687915.725586:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9af3fc393000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788687915.725599:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788687915.725617:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875574839673344:0@lo:8:kworker.0 00000100:00100000:2.0:1788687915.725656:0:15163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839673856 00000100:00100000:2.0:1788687915.725662:0:15163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839673856 00000100:00100000:2.0:1788687915.725704:0:15163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788687915.725713:0:15163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839673856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788687915.725740:0:15163:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687915.725790:0:15163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875574839673856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687915.725797:0:15163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788687915.725818:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788687915.725839:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c697f800 x1875574839673856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687915.725855:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839673856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788687915.725872:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839673984 00000100:00100000:2.0:1788687915.725876:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839673984 00000100:00100000:2.0:1788687915.725898:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788687915.725905:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14499:x1875574839673984:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788687915.735016:0:14501:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788687915.735046:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14501:1875574839674240:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788687915.735385:0:14501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687915.735417:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce900 going to sleep for 11 seconds 00000004:00080000:1.0:1788687915.735436:0:14500:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788687915.735699:0:14500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 461426217440ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788687915.736043:0:15159:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788687915.736051:0:15159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788687915.736280:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788687915.736295:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839674112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687915.736334:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687915.736376:0:15163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839674112 00000100:00100000:1.0:1788687915.736384:0:15163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839674112 00000100:00100000:1.0:1788687915.736434:0:15163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788687915.736442:0:15163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875574839674112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687915.736465:0:15163:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687915.736527:0:15163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875574839674112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687915.736534:0:15163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788687915.736576:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3ffe38e00 x1875574839674112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788687931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687915.736596:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839674112:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788687915.736628:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788687915.736669:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839674240 00000100:00100000:1.0:1788687915.736673:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839674240 00000100:00100000:1.0:1788687915.736811:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788687915.736819:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14501:x1875574839674240:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788687915.740351:0:15953:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788687915.740362:0:15953:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788687915.740368:0:15953:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00080000:2.0:1788687915.742195:0:15160:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788687915.742205:0:15160:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788687915.742211:0:15160:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1788687915.749106:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.749120:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449f42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749138:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.749143:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.749150:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449f42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749184:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449f42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749195:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449f42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749204:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449f42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749227:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788687915.749242:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687915.749247:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449f42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749254:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687915.749259:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449f42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749267:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449f42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749284:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449f42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749293:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e74449f42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749319:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.749322:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.749323:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788687915.749859:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.749866:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e74449f49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749876:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.749880:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.749885:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e74449f49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749896:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e74449f49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749904:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e74449f49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749912:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e74449f49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749932:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788687915.749943:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687915.749948:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e74449f49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749968:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cda00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687915.749972:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e74449f49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749981:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e74449f49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.749993:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e74449f49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750001:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e74449f49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750015:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.750017:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.750018:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788687915.750431:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.750439:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e74449f50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750448:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.750451:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.750455:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e74449f50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750465:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e74449f50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750504:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e74449f50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750513:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e74449f50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750528:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788687915.750536:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687915.750540:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e74449f50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750546:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cdc00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687915.750550:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e74449f50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750557:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e74449f50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750568:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e74449f50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750576:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e74449f50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.750589:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.750596:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.750598:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788687915.751015:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.751022:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e74449f57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751032:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.751036:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.751041:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e74449f57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751050:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e74449f57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751059:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e74449f57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751067:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e74449f57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751081:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788687915.751090:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687915.751094:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e74449f57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751101:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cca00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687915.751104:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e74449f57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751124:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e74449f57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751135:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e74449f57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751142:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e74449f57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751156:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.751158:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.751159:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788687915.751579:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.751585:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e74449f5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751594:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.751597:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.751621:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e74449f5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751633:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e74449f5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751641:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e74449f5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751655:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e74449f5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751671:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788687915.751681:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687915.751685:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e74449f5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751692:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd600 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687915.751696:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e74449f5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751704:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e74449f5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751717:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e74449f5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751724:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e74449f5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.751738:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.751740:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.751741:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.755661:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.755672:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd78efc3/0xc2ddd83e74449f65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.755690:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.755695:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.755702:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd78efc3/0xc2ddd83e74449f65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.755844:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd78efc3/0xc2ddd83e74449f65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.755857:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd78efc3/0xc2ddd83e74449f65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.755876:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd78efc3/0xc2ddd83e74449f65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.755895:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788687915.756166:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687915.756174:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd78efc3/0xc2ddd83e74449f65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.756183:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687915.756187:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd78efc3/0xc2ddd83e74449f65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.756197:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd78efc3/0xc2ddd83e74449f65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.756216:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd78efc3/0xc2ddd83e74449f65 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.756224:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd78efc3/0xc2ddd83e74449f65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.756251:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687915.756253:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687915.756255:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.756475:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.756508:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0b1d85a/0xc2ddd83e74449f6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.756518:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.756522:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.756527:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0b1d85a/0xc2ddd83e74449f6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.756537:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0b1d85a/0xc2ddd83e74449f6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.756546:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0b1d85a/0xc2ddd83e74449f6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.756554:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0b1d85a/0xc2ddd83e74449f6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.756582:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.756589:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.756594:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0b1d85a/0xc2ddd83e74449f6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.756622:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.756625:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0b1d85a/0xc2ddd83e74449f6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.756633:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0b1d85a/0xc2ddd83e74449f6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.756645:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0b1d85a/0xc2ddd83e74449f6c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.756653:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0b1d85a/0xc2ddd83e74449f6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.756665:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.756667:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.756669:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.757032:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.757038:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9134900/0xc2ddd83e74449f73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.757047:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.757049:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.757054:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9134900/0xc2ddd83e74449f73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.757063:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9134900/0xc2ddd83e74449f73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.757078:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9134900/0xc2ddd83e74449f73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.757086:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9134900/0xc2ddd83e74449f73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.757222:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.757231:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.757235:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9134900/0xc2ddd83e74449f73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.757242:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2600 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.757246:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9134900/0xc2ddd83e74449f73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.757254:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9134900/0xc2ddd83e74449f73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.757265:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9134900/0xc2ddd83e74449f73 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.757272:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9134900/0xc2ddd83e74449f73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.757286:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.757293:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.757295:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.758007:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.758013:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c00bcc29/0xc2ddd83e74449f7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758025:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.758028:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.758034:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c00bcc29/0xc2ddd83e74449f7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758045:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c00bcc29/0xc2ddd83e74449f7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758053:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c00bcc29/0xc2ddd83e74449f7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758060:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c00bcc29/0xc2ddd83e74449f7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758074:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.758081:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.758085:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c00bcc29/0xc2ddd83e74449f7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758092:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.758348:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00bcc29/0xc2ddd83e74449f7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758370:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00bcc29/0xc2ddd83e74449f7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758384:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c00bcc29/0xc2ddd83e74449f7a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758391:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c00bcc29/0xc2ddd83e74449f7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758406:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.758408:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.758410:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.758846:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.758852:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3a956aa/0xc2ddd83e74449f81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758862:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.758865:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.758870:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3a956aa/0xc2ddd83e74449f81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758879:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3a956aa/0xc2ddd83e74449f81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758887:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3a956aa/0xc2ddd83e74449f81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758901:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3a956aa/0xc2ddd83e74449f81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758914:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.758922:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.758925:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3a956aa/0xc2ddd83e74449f81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758932:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.758935:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3a956aa/0xc2ddd83e74449f81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758942:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3a956aa/0xc2ddd83e74449f81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758952:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3a956aa/0xc2ddd83e74449f81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758959:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3a956aa/0xc2ddd83e74449f81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.758971:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.758972:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.758974:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.759547:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.759560:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075939720/0xc2ddd83e74449f88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.759569:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.759572:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.759576:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075939720/0xc2ddd83e74449f88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.759586:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075939720/0xc2ddd83e74449f88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.759595:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075939720/0xc2ddd83e74449f88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.759616:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075939720/0xc2ddd83e74449f88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.759631:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.759640:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.759644:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075939720/0xc2ddd83e74449f88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.759651:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2a00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.759654:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075939720/0xc2ddd83e74449f88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.759662:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075939720/0xc2ddd83e74449f88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.759681:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075939720/0xc2ddd83e74449f88 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.759689:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075939720/0xc2ddd83e74449f88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.759703:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.759705:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.759707:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.760366:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.760372:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ea7816e/0xc2ddd83e74449f8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760382:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.760385:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.760389:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ea7816e/0xc2ddd83e74449f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760398:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ea7816e/0xc2ddd83e74449f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760405:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ea7816e/0xc2ddd83e74449f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760412:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ea7816e/0xc2ddd83e74449f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760437:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.760448:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.760452:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ea7816e/0xc2ddd83e74449f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760458:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d2e00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.760462:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ea7816e/0xc2ddd83e74449f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760469:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ea7816e/0xc2ddd83e74449f8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760498:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ea7816e/0xc2ddd83e74449f8f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760505:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ea7816e/0xc2ddd83e74449f8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760517:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.760519:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.760520:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.760913:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.760919:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e74449f96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760927:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.760936:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.760940:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e74449f96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760950:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e74449f96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760959:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e74449f96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760966:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e74449f96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.760989:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.761340:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.761347:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e74449f96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.761355:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3c00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.761358:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e74449f96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.761365:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e74449f96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.761380:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e74449f96 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.761388:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fabf014b/0xc2ddd83e74449f96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.761406:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.761408:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.761409:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.761870:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.761877:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2607efe/0xc2ddd83e74449f9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.761885:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.761888:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.761892:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2607efe/0xc2ddd83e74449f9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.761903:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2607efe/0xc2ddd83e74449f9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.761911:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2607efe/0xc2ddd83e74449f9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.761925:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2607efe/0xc2ddd83e74449f9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.761943:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788687915.762423:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.762429:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449fa4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.762438:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.762441:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.762446:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449fa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.762455:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449fa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.762462:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449fa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.762469:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449fa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.762505:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788687915.762704:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788687915.762712:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2607efe/0xc2ddd83e74449f9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.762720:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687915.762723:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2607efe/0xc2ddd83e74449f9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.762731:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2607efe/0xc2ddd83e74449f9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.762743:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2607efe/0xc2ddd83e74449f9d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.762750:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2607efe/0xc2ddd83e74449f9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.762766:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687915.762769:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449fa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.762774:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f15d3e00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687915.762781:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449fa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.762788:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449fa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.762796:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449fa4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.762803:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bcad2da/0xc2ddd83e74449fa4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.762812:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687915.762814:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687915.762815:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.763203:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.763785:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.763792:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000153c2b5d/0xc2ddd83e74449fab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.763809:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.763812:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.763817:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000153c2b5d/0xc2ddd83e74449fab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.763828:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000153c2b5d/0xc2ddd83e74449fab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.763838:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000153c2b5d/0xc2ddd83e74449fab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.763845:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000153c2b5d/0xc2ddd83e74449fab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.763861:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.763870:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.763875:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000153c2b5d/0xc2ddd83e74449fab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.763881:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9e00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.763885:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000153c2b5d/0xc2ddd83e74449fab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.763893:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000153c2b5d/0xc2ddd83e74449fab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.763917:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000153c2b5d/0xc2ddd83e74449fab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.763924:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000153c2b5d/0xc2ddd83e74449fab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.763938:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.763939:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.763941:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788687915.764288:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788687915.764295:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e8f549/0xc2ddd83e74449fb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.764304:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788687915.764307:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687915.764311:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e8f549/0xc2ddd83e74449fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.764322:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062e8f549/0xc2ddd83e74449fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.764329:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e8f549/0xc2ddd83e74449fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.764368:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062e8f549/0xc2ddd83e74449fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788687915.764628:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.764633:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e520792b/0xc2ddd83e74449fb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.764642:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.764644:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.764648:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e520792b/0xc2ddd83e74449fb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.764657:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e520792b/0xc2ddd83e74449fb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.764665:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e520792b/0xc2ddd83e74449fb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.764672:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e520792b/0xc2ddd83e74449fb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.764693:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788687915.765047:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.765053:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df023cb6/0xc2ddd83e74449fc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765061:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.765063:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.765067:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df023cb6/0xc2ddd83e74449fc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765076:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df023cb6/0xc2ddd83e74449fc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765083:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df023cb6/0xc2ddd83e74449fc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765090:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df023cb6/0xc2ddd83e74449fc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765215:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788687915.765225:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788687915.765229:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e520792b/0xc2ddd83e74449fb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765236:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8e00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.765245:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e520792b/0xc2ddd83e74449fb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765252:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e520792b/0xc2ddd83e74449fb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765264:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e520792b/0xc2ddd83e74449fb9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765270:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e520792b/0xc2ddd83e74449fb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765284:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.765286:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df023cb6/0xc2ddd83e74449fc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765292:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.765294:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df023cb6/0xc2ddd83e74449fc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765300:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df023cb6/0xc2ddd83e74449fc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765307:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df023cb6/0xc2ddd83e74449fc0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765314:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df023cb6/0xc2ddd83e74449fc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765328:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.765330:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.765332:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.765726:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.765732:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfba9458/0xc2ddd83e74449fc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765740:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.765743:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.765746:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfba9458/0xc2ddd83e74449fc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765755:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfba9458/0xc2ddd83e74449fc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765763:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfba9458/0xc2ddd83e74449fc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765770:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfba9458/0xc2ddd83e74449fc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.765782:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.766661:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.766670:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfba9458/0xc2ddd83e74449fc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.766691:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.766695:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfba9458/0xc2ddd83e74449fc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.766703:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfba9458/0xc2ddd83e74449fc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.766719:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfba9458/0xc2ddd83e74449fc7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.766726:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfba9458/0xc2ddd83e74449fc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.766742:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.766743:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.766745:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.767191:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.767382:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.767389:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e74449fce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.767403:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.767406:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.767412:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e74449fce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.767422:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e74449fce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.767437:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e74449fce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.767445:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e74449fce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.767545:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788687915.767974:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.767980:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000565f6da3/0xc2ddd83e74449fd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.767990:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.767993:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.767997:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000565f6da3/0xc2ddd83e74449fd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.768006:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000565f6da3/0xc2ddd83e74449fd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.768014:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000565f6da3/0xc2ddd83e74449fd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.768022:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000565f6da3/0xc2ddd83e74449fd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.768290:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788687915.768298:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e74449fce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.768313:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9600 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.768318:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e74449fce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.768327:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e74449fce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.768343:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e74449fce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.768351:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e74449fce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.768582:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.768587:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000565f6da3/0xc2ddd83e74449fd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.768594:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.768598:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000565f6da3/0xc2ddd83e74449fd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.768618:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000565f6da3/0xc2ddd83e74449fd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.768629:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000565f6da3/0xc2ddd83e74449fd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.768644:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.768646:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.768648:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.768874:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.768881:0:15160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000565f6da3/0xc2ddd83e74449fd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.768959:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788687915.768959:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788687915.768964:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062e8f549/0xc2ddd83e74449fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.768971:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed600 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.768974:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e8f549/0xc2ddd83e74449fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.768983:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e8f549/0xc2ddd83e74449fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.768998:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062e8f549/0xc2ddd83e74449fb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.769005:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062e8f549/0xc2ddd83e74449fb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.769020:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.769021:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.769023:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.769933:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:0.0:1788687915.769933:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788687915.769942:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449fe3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.769943:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051faefa/0xc2ddd83e74449fdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.769957:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788687915.769957:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.769961:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687915.769961:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.769967:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051faefa/0xc2ddd83e74449fdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.769967:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.769980:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051faefa/0xc2ddd83e74449fdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.769980:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.769990:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051faefa/0xc2ddd83e74449fdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.769990:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.769999:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051faefa/0xc2ddd83e74449fdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.769999:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.770018:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788687915.770251:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788687915.770262:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788687915.770267:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.770275:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.770279:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.770288:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.770312:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449fe3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.770319:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8b2f39f/0xc2ddd83e74449fe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.770334:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.770337:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051faefa/0xc2ddd83e74449fdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.770344:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8c00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.770347:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051faefa/0xc2ddd83e74449fdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.770355:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051faefa/0xc2ddd83e74449fdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.770364:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051faefa/0xc2ddd83e74449fdc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.770371:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051faefa/0xc2ddd83e74449fdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.770383:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.770385:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.770391:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788687915.771925:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788687915.771936:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c04bf924/0xc2ddd83e74449fea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.771961:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788687915.771966:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687915.771971:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c04bf924/0xc2ddd83e74449fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.771986:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c04bf924/0xc2ddd83e74449fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.771997:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c04bf924/0xc2ddd83e74449fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.772004:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c04bf924/0xc2ddd83e74449fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.772026:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.772252:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.772258:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c04bf924/0xc2ddd83e74449fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772267:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eca00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.772271:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c04bf924/0xc2ddd83e74449fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772280:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c04bf924/0xc2ddd83e74449fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772297:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c04bf924/0xc2ddd83e74449fea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772304:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c04bf924/0xc2ddd83e74449fea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772320:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.772322:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.772323:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788687915.772544:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:2.0:1788687915.772715:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.772721:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a3e0b8e/0xc2ddd83e74449ff8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772731:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.772734:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.772739:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a3e0b8e/0xc2ddd83e74449ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772754:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a3e0b8e/0xc2ddd83e74449ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772762:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a3e0b8e/0xc2ddd83e74449ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772768:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a3e0b8e/0xc2ddd83e74449ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772782:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.772791:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.772794:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a3e0b8e/0xc2ddd83e74449ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772800:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.772803:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a3e0b8e/0xc2ddd83e74449ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772809:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a3e0b8e/0xc2ddd83e74449ff8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772819:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a3e0b8e/0xc2ddd83e74449ff8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772826:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a3e0b8e/0xc2ddd83e74449ff8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.772845:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.772846:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.772848:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.774461:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.774470:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c892b75/0xc2ddd83e74449fff lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774503:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.774508:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.774514:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c892b75/0xc2ddd83e74449fff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774526:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c892b75/0xc2ddd83e74449fff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774535:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c892b75/0xc2ddd83e74449fff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774543:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c892b75/0xc2ddd83e74449fff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774561:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.774572:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.774576:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c892b75/0xc2ddd83e74449fff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774594:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.774599:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c892b75/0xc2ddd83e74449fff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774621:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c892b75/0xc2ddd83e74449fff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774635:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c892b75/0xc2ddd83e74449fff lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774643:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c892b75/0xc2ddd83e74449fff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.774652:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000763c5230/0xc2ddd83e74449ff1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774660:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.774661:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.774663:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687915.774663:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788687915.774666:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687915.774671:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000763c5230/0xc2ddd83e74449ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.774681:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000763c5230/0xc2ddd83e74449ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.774701:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000763c5230/0xc2ddd83e74449ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.774708:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000763c5230/0xc2ddd83e74449ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.774727:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.774732:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.774736:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000763c5230/0xc2ddd83e74449ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774743:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ecc00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.774747:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000763c5230/0xc2ddd83e74449ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774754:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000763c5230/0xc2ddd83e74449ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774771:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000763c5230/0xc2ddd83e74449ff1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774779:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000763c5230/0xc2ddd83e74449ff1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.774794:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.774796:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.774797:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.775314:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.776057:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.776065:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c999ce8/0xc2ddd83e7444a006 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.776078:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.776082:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.776088:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c999ce8/0xc2ddd83e7444a006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788687915.777301:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788687915.777311:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444a00d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.777327:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788687915.777331:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687915.777337:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444a00d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.777353:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444a00d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.777365:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444a00d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.777374:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444a00d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.777412:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.778886:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c999ce8/0xc2ddd83e7444a006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.778900:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c999ce8/0xc2ddd83e7444a006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.778908:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c999ce8/0xc2ddd83e7444a006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.778939:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.778945:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444a00d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.778953:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79edc00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.778958:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444a00d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.778967:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444a00d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.778985:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444a00d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779003:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc7a95e4/0xc2ddd83e7444a00d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779024:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.779026:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.779027:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.779041:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788687915.779629:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.779637:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ad0535/0xc2ddd83e7444a014 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779651:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.779661:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.779667:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ad0535/0xc2ddd83e7444a014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779678:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ad0535/0xc2ddd83e7444a014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779686:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ad0535/0xc2ddd83e7444a014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779694:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ad0535/0xc2ddd83e7444a014 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779709:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788687915.779718:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788687915.779722:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c999ce8/0xc2ddd83e7444a006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779729:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8a00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.779733:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c999ce8/0xc2ddd83e7444a006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779741:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c999ce8/0xc2ddd83e7444a006 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779753:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c999ce8/0xc2ddd83e7444a006 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779771:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c999ce8/0xc2ddd83e7444a006 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779787:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.779790:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ad0535/0xc2ddd83e7444a014 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779796:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d8600 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.779800:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ad0535/0xc2ddd83e7444a014 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779807:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ad0535/0xc2ddd83e7444a014 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779817:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ad0535/0xc2ddd83e7444a014 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779824:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ad0535/0xc2ddd83e7444a014 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.779835:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.779836:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.779838:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788687915.780002:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788687915.780009:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009faa8d9/0xc2ddd83e7444a01b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.780017:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788687915.780020:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687915.780024:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009faa8d9/0xc2ddd83e7444a01b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.780034:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009faa8d9/0xc2ddd83e7444a01b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.780041:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009faa8d9/0xc2ddd83e7444a01b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.780048:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009faa8d9/0xc2ddd83e7444a01b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.780067:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.780101:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.780106:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009faa8d9/0xc2ddd83e7444a01b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780118:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.780121:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009faa8d9/0xc2ddd83e7444a01b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780129:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009faa8d9/0xc2ddd83e7444a01b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780140:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009faa8d9/0xc2ddd83e7444a01b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780148:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009faa8d9/0xc2ddd83e7444a01b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780162:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.780164:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.780166:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.780307:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.780313:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58d605b/0xc2ddd83e7444a022 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780321:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.780324:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.780328:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b58d605b/0xc2ddd83e7444a022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780337:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b58d605b/0xc2ddd83e7444a022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780350:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58d605b/0xc2ddd83e7444a022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780357:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b58d605b/0xc2ddd83e7444a022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780370:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.780378:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.780381:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b58d605b/0xc2ddd83e7444a022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780388:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.780392:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58d605b/0xc2ddd83e7444a022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780399:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58d605b/0xc2ddd83e7444a022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780411:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b58d605b/0xc2ddd83e7444a022 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780418:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58d605b/0xc2ddd83e7444a022 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788687915.780423:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788687915.780428:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d147e0ac/0xc2ddd83e7444a029 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780431:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687915.780435:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.780437:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.780438:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788687915.780442:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687915.780447:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d147e0ac/0xc2ddd83e7444a029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.780456:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d147e0ac/0xc2ddd83e7444a029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.780464:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d147e0ac/0xc2ddd83e7444a029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.780471:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d147e0ac/0xc2ddd83e7444a029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687915.780504:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.780508:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.780512:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d147e0ac/0xc2ddd83e7444a029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780519:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ece00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.780523:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d147e0ac/0xc2ddd83e7444a029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780531:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d147e0ac/0xc2ddd83e7444a029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780542:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d147e0ac/0xc2ddd83e7444a029 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780549:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d147e0ac/0xc2ddd83e7444a029 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780562:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.780564:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.780565:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.780907:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.780913:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085296eda/0xc2ddd83e7444a030 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780922:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.780924:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.780934:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085296eda/0xc2ddd83e7444a030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780943:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085296eda/0xc2ddd83e7444a030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780952:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085296eda/0xc2ddd83e7444a030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780959:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085296eda/0xc2ddd83e7444a030 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780971:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.780979:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.780982:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085296eda/0xc2ddd83e7444a030 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780989:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.780991:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085296eda/0xc2ddd83e7444a030 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.780998:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085296eda/0xc2ddd83e7444a030 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.781740:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085296eda/0xc2ddd83e7444a030 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.781761:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085296eda/0xc2ddd83e7444a030 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.781778:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.781780:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.781782:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.782070:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.783209:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.783217:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd76d33/0xc2ddd83e7444a037 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.783231:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.783235:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.783242:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bd76d33/0xc2ddd83e7444a037 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.783256:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bd76d33/0xc2ddd83e7444a037 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.783267:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd76d33/0xc2ddd83e7444a037 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.783275:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bd76d33/0xc2ddd83e7444a037 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.783294:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.783308:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.783317:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bd76d33/0xc2ddd83e7444a037 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.783328:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9c00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.783333:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd76d33/0xc2ddd83e7444a037 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.783344:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd76d33/0xc2ddd83e7444a037 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.783361:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bd76d33/0xc2ddd83e7444a037 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.783369:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bd76d33/0xc2ddd83e7444a037 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.783391:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.783393:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.783395:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.784276:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.784291:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e7444a03e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.784304:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.784308:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.784313:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e7444a03e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788687915.784314:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.784326:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e7444a03e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784329:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a045 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.784345:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e7444a03e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784347:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788687915.784355:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687915.784363:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.784365:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e7444a03e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784391:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.784401:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.784404:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784414:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784428:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.784434:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e7444a03e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784442:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4021d9600 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.784446:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e7444a03e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784454:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e7444a03e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784502:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e7444a03e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784510:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034e0e81e/0xc2ddd83e7444a03e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784534:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.784537:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.784539:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.784845:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.784856:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.784861:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788687915.784861:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.784871:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92d327b/0xc2ddd83e7444a04c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784875:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.784881:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.784885:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.784891:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687915.784896:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a045 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.784898:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92d327b/0xc2ddd83e7444a04c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.784921:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92d327b/0xc2ddd83e7444a04c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784924:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a045 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784948:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a045 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.784950:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92d327b/0xc2ddd83e7444a04c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.784965:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92d327b/0xc2ddd83e7444a04c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.784998:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.785002:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92d327b/0xc2ddd83e7444a04c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.785004:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788687915.785013:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4c200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.785017:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92d327b/0xc2ddd83e7444a04c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.785026:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92d327b/0xc2ddd83e7444a04c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.785039:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92d327b/0xc2ddd83e7444a04c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.785046:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92d327b/0xc2ddd83e7444a04c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.785060:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.785062:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.785065:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.785072:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.785806:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.785812:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1075b0/0xc2ddd83e7444a053 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.785823:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.785826:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.785831:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1075b0/0xc2ddd83e7444a053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.785841:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1075b0/0xc2ddd83e7444a053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.785850:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1075b0/0xc2ddd83e7444a053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.785857:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1075b0/0xc2ddd83e7444a053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.785882:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.785890:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.785894:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1075b0/0xc2ddd83e7444a053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.785901:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4ca00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687915.785905:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1075b0/0xc2ddd83e7444a053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.785913:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1075b0/0xc2ddd83e7444a053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.785926:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1075b0/0xc2ddd83e7444a053 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.785934:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1075b0/0xc2ddd83e7444a053 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788687915.785939:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788687915.785947:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.785948:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.785950:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788687915.786964:0:15160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.786972:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f1ec224/0xc2ddd83e7444a05a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.786985:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.787590:0:15160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687915.787596:0:15160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f1ec224/0xc2ddd83e7444a05a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.787620:0:15160:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f1ec224/0xc2ddd83e7444a05a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.787630:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f1ec224/0xc2ddd83e7444a05a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.787637:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f1ec224/0xc2ddd83e7444a05a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.787653:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788687915.787867:0:15160:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788687915.788338:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14499:x1875574839673984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 62428us (63245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687915.788348:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788687915.789349:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14499:1875574839673984:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788687915.789367:0:14499:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788687915.789414:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14499:1875574839674368:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1788687915.790062:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.790072:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f1ec224/0xc2ddd83e7444a05a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.790085:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4c000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.790097:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f1ec224/0xc2ddd83e7444a05a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.790108:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f1ec224/0xc2ddd83e7444a05a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.790205:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f1ec224/0xc2ddd83e7444a05a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.790232:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f1ec224/0xc2ddd83e7444a05a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.790256:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.790259:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.790261:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687915.790303:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687915.790368:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788687915.790370:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839674368 00000100:00100000:1.0:1788687915.790390:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839674368 00000100:00100000:1.0:1788687915.790439:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788687915.790448:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14499:x1875574839674368:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788687915.790513:0:15159:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00002000:00010000:3.0:1788687915.791103:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788687915.791110:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc278ff/0xc2ddd83e7444a061 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.791198:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788687915.791204:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687915.791214:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc278ff/0xc2ddd83e7444a061 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.791230:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc278ff/0xc2ddd83e7444a061 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.791240:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc278ff/0xc2ddd83e7444a061 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.791255:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fc278ff/0xc2ddd83e7444a061 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.792269:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788687915.793182:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687915.793192:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fc278ff/0xc2ddd83e7444a061 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788687915.793197:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788687915.793209:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.793210:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006130ef1e/0xc2ddd83e7444a068 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.793217:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc278ff/0xc2ddd83e7444a061 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.793227:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788687915.793231:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc278ff/0xc2ddd83e7444a061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.793233:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687915.793240:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006130ef1e/0xc2ddd83e7444a068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.793261:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006130ef1e/0xc2ddd83e7444a068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.793264:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fc278ff/0xc2ddd83e7444a061 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.793274:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006130ef1e/0xc2ddd83e7444a068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.793277:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc278ff/0xc2ddd83e7444a061 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.793292:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006130ef1e/0xc2ddd83e7444a068 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.793307:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.793311:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788687915.793312:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006130ef1e/0xc2ddd83e7444a068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.793322:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aadc00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.793323:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.793326:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006130ef1e/0xc2ddd83e7444a068 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.793336:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006130ef1e/0xc2ddd83e7444a068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.793347:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006130ef1e/0xc2ddd83e7444a068 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.793354:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006130ef1e/0xc2ddd83e7444a068 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687915.793365:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.793367:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687915.793373:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788687915.794216:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788687915.794232:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc4dc05d/0xc2ddd83e7444a06f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.794245:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788687915.794249:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687915.794254:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc4dc05d/0xc2ddd83e7444a06f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.794265:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc4dc05d/0xc2ddd83e7444a06f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.794274:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc4dc05d/0xc2ddd83e7444a06f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.794282:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc4dc05d/0xc2ddd83e7444a06f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.794298:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.794309:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.794314:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc4dc05d/0xc2ddd83e7444a06f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.794322:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.794327:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc4dc05d/0xc2ddd83e7444a06f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.794796:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc4dc05d/0xc2ddd83e7444a06f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.794822:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc4dc05d/0xc2ddd83e7444a06f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.794830:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc4dc05d/0xc2ddd83e7444a06f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.794853:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.794857:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.794859:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788687915.795965:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788687915.795975:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035acf05d/0xc2ddd83e7444a076 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.795989:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788687915.795994:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687915.795999:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035acf05d/0xc2ddd83e7444a076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.796012:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035acf05d/0xc2ddd83e7444a076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.796021:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035acf05d/0xc2ddd83e7444a076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.796028:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035acf05d/0xc2ddd83e7444a076 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.796059:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.796071:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.796077:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035acf05d/0xc2ddd83e7444a076 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.796086:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.796090:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035acf05d/0xc2ddd83e7444a076 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.796099:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035acf05d/0xc2ddd83e7444a076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.796113:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035acf05d/0xc2ddd83e7444a076 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.796196:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035acf05d/0xc2ddd83e7444a076 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.796215:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.796218:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.796222:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788687915.797086:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788687915.797094:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d2f43d/0xc2ddd83e7444a07d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.797106:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788687915.797117:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687915.797203:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d2f43d/0xc2ddd83e7444a07d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.797217:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4d2f43d/0xc2ddd83e7444a07d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.797227:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d2f43d/0xc2ddd83e7444a07d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.797235:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d2f43d/0xc2ddd83e7444a07d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.797255:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.797267:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.797272:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4d2f43d/0xc2ddd83e7444a07d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.797281:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aada00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.797286:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d2f43d/0xc2ddd83e7444a07d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.797294:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d2f43d/0xc2ddd83e7444a07d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.797309:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4d2f43d/0xc2ddd83e7444a07d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.797402:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4d2f43d/0xc2ddd83e7444a07d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.797427:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.797429:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.797433:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788687915.798281:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788687915.798288:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a084 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.798301:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788687915.798305:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687915.798311:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.798322:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.798786:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.798795:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.798814:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.798828:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.798841:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.798849:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.798853:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.798862:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.798878:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a084 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.798886:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecaae1e3/0xc2ddd83e7444a084 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.798909:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.798912:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.798915:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788687915.799827:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788687915.799836:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e57954/0xc2ddd83e7444a08b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.799848:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788687915.799851:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687915.799856:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e57954/0xc2ddd83e7444a08b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.799877:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7e57954/0xc2ddd83e7444a08b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.799885:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e57954/0xc2ddd83e7444a08b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.799892:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e57954/0xc2ddd83e7444a08b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.799907:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.799917:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.799922:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7e57954/0xc2ddd83e7444a08b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.799929:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aace00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.799933:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e57954/0xc2ddd83e7444a08b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.799942:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e57954/0xc2ddd83e7444a08b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.799955:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7e57954/0xc2ddd83e7444a08b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.799962:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7e57954/0xc2ddd83e7444a08b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.799984:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.799986:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.799988:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788687915.801295:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788687915.801304:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a2d694/0xc2ddd83e7444a092 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.801319:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788687915.801323:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687915.801329:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a2d694/0xc2ddd83e7444a092 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.801342:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a2d694/0xc2ddd83e7444a092 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.801353:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a2d694/0xc2ddd83e7444a092 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.801361:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a2d694/0xc2ddd83e7444a092 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.801378:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.801388:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.801394:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0a2d694/0xc2ddd83e7444a092 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.801414:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aacc00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.801418:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a2d694/0xc2ddd83e7444a092 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.801428:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a2d694/0xc2ddd83e7444a092 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.801444:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0a2d694/0xc2ddd83e7444a092 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.801452:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a2d694/0xc2ddd83e7444a092 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.801472:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.801476:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.801514:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687915.804961:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14499:x1875574839674368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14506us (14652us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788687915.804975:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788687915.805240:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14499:1875574839674368:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788687915.805258:0:14499:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00002000:00010000:1.0:1788687915.805689:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.805700:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e7444a099 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.805716:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.805721:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.805729:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e7444a099 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.805743:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e7444a099 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.805755:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e7444a099 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.805944:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e7444a099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.805983:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788687915.806177:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.806185:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e7444a099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.806193:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd600 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.806198:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e7444a099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.806207:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e7444a099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.806237:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e7444a099 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.806245:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080777d39/0xc2ddd83e7444a099 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.806264:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.806266:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.806268:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788687915.806815:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.806822:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e7444a0a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.806834:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.806838:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.806844:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e7444a0a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.806854:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e7444a0a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.806863:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e7444a0a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.806870:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e7444a0a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.806933:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788687915.807340:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.807346:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e7444a0a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.807355:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.807365:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.807370:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e7444a0a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.807379:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e7444a0a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.807387:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e7444a0a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.807395:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e7444a0a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.807526:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788687915.807533:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e7444a0a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.807542:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cca00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.807547:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e7444a0a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.807557:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e7444a0a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.807572:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e7444a0a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.807579:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2fdb9a1/0xc2ddd83e7444a0a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.807619:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.807623:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e7444a0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.807630:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cdc00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.807634:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e7444a0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.807642:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e7444a0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.807653:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e7444a0a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.807660:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.807662:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.807664:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.807828:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788687915.807834:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000720db45c/0xc2ddd83e7444a0a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687915.808369:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.808376:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e7444a0ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.808386:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.808390:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.808395:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e7444a0ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.808404:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e7444a0ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.808419:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e7444a0ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.808427:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e7444a0ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.808577:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.808583:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e7444a0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.808591:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cda00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.808595:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e7444a0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.808626:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e7444a0ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.808639:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e7444a0ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.808647:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.808649:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.808651:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.808735:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788687915.808741:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acdd6544/0xc2ddd83e7444a0ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687915.809241:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.809248:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e7444a0b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.809259:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.809262:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.809267:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e7444a0b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.809278:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e7444a0b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.809287:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e7444a0b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.809305:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e7444a0b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.809335:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.809341:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e7444a0b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.809348:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd000 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.809353:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e7444a0b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.809360:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e7444a0b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.809373:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e7444a0b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.809381:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.809383:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.809385:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.809454:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788687915.809460:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e1cc76/0xc2ddd83e7444a0b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788687915.810659:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788687915.810668:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bde5af16/0xc2ddd83e7444a0bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.810681:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788687915.810685:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687915.810690:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bde5af16/0xc2ddd83e7444a0bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.810702:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bde5af16/0xc2ddd83e7444a0bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.810711:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bde5af16/0xc2ddd83e7444a0bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687915.810718:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bde5af16/0xc2ddd83e7444a0bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.810850:0:14465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788687915.810857:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bde5af16/0xc2ddd83e7444a0bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.810865:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38ccc00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687915.810870:0:14465:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bde5af16/0xc2ddd83e7444a0bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.810878:0:14465:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bde5af16/0xc2ddd83e7444a0bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.810893:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bde5af16/0xc2ddd83e7444a0bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687915.810975:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.810977:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687915.810979:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687915.811045:0:15953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788687915.811051:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bde5af16/0xc2ddd83e7444a0bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788687915.811292:0:15953:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1788687915.811387:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14501:x1875574839674240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 74564us (75998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687915.811397:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788687915.811453:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14501:1875574839674240:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788687915.811470:0:14501:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788687915.811686:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14501:1875574839674496:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788687915.811721:0:14501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687915.811760:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce900 going to sleep for 11 seconds 00000100:00100000:1.0:1788687915.811775:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839674496 00000100:00100000:1.0:1788687915.811781:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839674496 00000100:00100000:1.0:1788687915.811827:0:15162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788687915.811836:0:15162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14501:x1875574839674496:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788687915.811875:0:15162:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1788687915.814633:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687915.817772:0:15162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14501:x1875574839674496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5929us (6042us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788687915.817786:0:15162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788687915.817848:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14501:1875574839674496:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788687915.817867:0:14501:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1788687915.841651:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788687915.845645:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788687916.293616:0:14473:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788687916.293624:0:14473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af2c1b98800 from 8 10000000:01000000:0.0:1788687916.293628:0:14473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788687916.293678:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79ede00/0xc2ddd83e7444a0c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687916.293691:0:14473:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f79ede00/0xc2ddd83e7444a0c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687916.293838:0:14473:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f79ede00/0xc2ddd83e7444a0c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687916.293868:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839674624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788687916.293941:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687916.294159:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788687916.294306:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839674624 00000100:00100000:1.0:1788687916.294315:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839674624 00000100:00100000:1.0:1788687916.294430:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788687916.294439:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:14473:x1875574839674624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687916.294452:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687916.294466:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cd000/0xc2ddd83e7444a0ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e7444a0c3 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687916.294525:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cd000/0xc2ddd83e7444a0ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e7444a0c3 expref: 19 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687916.294536:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cd000/0xc2ddd83e7444a0ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e7444a0c3 expref: 19 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687916.294546:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd000, rc 0) 00000100:00100000:1.0:1788687916.294588:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:14473:x1875574839674624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687916.294612:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788687916.294694:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839674624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788687916.294720:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f79ede00/0xc2ddd83e7444a0c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a0ca expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687916.294730:0:14473:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f79ede00/0xc2ddd83e7444a0c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e7444a0ca expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687916.294794:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839674752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788687916.294828:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687916.296565:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c5b2f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788687916.298639:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839674752 00000100:00100000:3.0:1788687916.298655:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839674752 00000100:00100000:3.0:1788687916.299971:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788687916.299992:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:14473:x1875574839674752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788687916.300023:0:14470:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788687916.300049:0:14470:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788687916.300053:0:14470:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788687916.300213:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:14473:x1875574839674752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 230us (5383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687916.300242:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788687916.300272:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839674752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788687916.300350:0:14473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788687916.300361:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f79ede00/0xc2ddd83e7444a0c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a0ca expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687916.300372:0:14473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f79ede00/0xc2ddd83e7444a0c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a0ca expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687916.872541:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687917.895588:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788687918.274292:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788687918.274343:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788687918.917741:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687919.949210:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788687920.290162:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788687920.290191:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:2.0:1788687920.650149:0:16237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788687920.971512:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687921.221834:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788687921.221856:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839674880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687921.221946:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687921.222128:0:15163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839674880 00000100:00100000:1.0:1788687921.222137:0:15163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839674880 00000100:00100000:1.0:1788687921.222195:0:15163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788687921.222205:0:15163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839674880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687921.222240:0:15163:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687921.222289:0:15163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839674880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687921.222303:0:15163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788687921.222344:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788687921.222365:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839674880:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788687921.222416:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788687921.222843:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839675392:0@lo:400:kworker.0 00000100:00100000:2.0:1788687921.222880:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687921.222906:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788687921.222912:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839675264:0@lo:400:kworker.0 00000100:00100000:2.0:1788687921.222950:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687921.222977:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839675008:0@lo:400:kworker.0 00000100:00100000:2.0:1788687921.223015:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687921.223200:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839675520:0@lo:400:kworker.0 00000100:00100000:2.0:1788687921.223223:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687921.223249:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788687921.223254:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839675136:0@lo:400:kworker.0 00000100:00100000:2.0:1788687921.223278:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687921.223294:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839675648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788687921.223314:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687921.223360:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839675392 00000100:00100000:1.0:1788687921.223367:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839675392 00000100:00100000:1.0:1788687921.223406:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839675264 00000100:00100000:1.0:1788687921.223409:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839675264 00000100:00100000:1.0:1788687921.223419:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839675520 00000100:00100000:1.0:1788687921.223422:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839675520 00000100:00100000:1.0:1788687921.223435:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788687921.223441:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839675392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687921.223507:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839675392:12345-0@lo:400:kworker.0 Request processed in 39us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687921.223515:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788687921.223528:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788687921.223534:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839675264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687921.223557:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839675264:12345-0@lo:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687921.223563:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788687921.223571:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788687921.223577:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839675520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687921.223596:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875574839675520:12345-0@lo:400:kworker.0 Request processed in 19us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687921.223601:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788687921.223627:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839675136 00000100:00100000:1.0:1788687921.223630:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839675136 00000100:00100000:1.0:1788687921.223672:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788687921.223677:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839675136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687921.223704:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839675136:12345-0@lo:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687921.223709:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788687921.223724:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788687921.223728:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687921.224429:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839675008 00000100:00100000:3.0:1788687921.224435:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839675008 00000100:00100000:3.0:1788687921.224465:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788687921.224472:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:3310:x1875574839675008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687921.224540:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:3310:x1875574839675008:12345-0@lo:400:kworker.0 Request processed in 68us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687921.224546:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788687921.225541:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788687921.225560:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839675136:0@lo:400:kworker.0 00000100:00100000:2.0:1788687921.225571:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839675008:0@lo:400:kworker.0 00010000:00080000:2.0:1788687921.225584:0:3310:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c697c000 x1875574839675520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788687921.226105:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875574839675520:0@lo:400:kworker.0 00010000:00080000:1.0:1788687921.227123:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c697f800 x1875574839675264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687921.227138:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839675264:0@lo:400:kworker.0 00010000:00080000:1.0:1788687921.227155:0:3313:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af3c697ca80 x1875574839675392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788687937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788687921.227163:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839675392:0@lo:400:kworker.0 00000100:00100000:1.0:1788687921.227242:0:15163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839675648 00000100:00100000:1.0:1788687921.227248:0:15163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839675648 00000100:00100000:1.0:1788687921.227298:0:15163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788687921.227306:0:15163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839675648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788687921.227341:0:15163:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687921.227411:0:15163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839675648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (4095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687921.227418:0:15163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788687921.227457:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839675648:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788687921.989638:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788687922.247267:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788687922.636847:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687922.637073:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819758720 00000100:00100000:2.0:1788687922.637083:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819758720 00000100:00100000:2.0:1788687922.637130:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:2.0:1788687922.637138:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2345:x1875574819758720:12345-192.168.204.26@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788687922.637168:0:14469:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 40e481c7-6b5b-4f65-8f9b-12aa1c55d216@192.168.204.26@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1788687922.637200:0:14469:0:(genops.c:1385:class_connect()) connect: client 40e481c7-6b5b-4f65-8f9b-12aa1c55d216, cookie 0xc2ddd83e7444a0d1 00000100:00080000:0.0:1788687922.641967:0:14469:0:(import.c:65:import_set_state_nolock()) ffff9af3e6e73000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788687922.642219:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+5:2345:x1875574819758720:12345-192.168.204.26@tcp:250:mount.lustre.0 Request processed in 5074us (5378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687922.642232:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:2.0:1788687922.647184:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687922.647291:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819758848 00000100:00100000:1.0:1788687922.647301:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819758848 00000100:00100000:1.0:1788687922.647371:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:1.0:1788687922.647381:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+5:13763:x1875574819758848:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788687922.647408:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687922.647426:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cca00/0xc2ddd83e7444a0d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462f10 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687922.647455:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cca00/0xc2ddd83e7444a0d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f10 expref: 6 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687922.647467:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cca00/0xc2ddd83e7444a0d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f10 expref: 6 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687922.647512:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cca00, rc 0) 00000100:00100000:1.0:1788687922.647576:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+6:13763:x1875574819758848:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 197us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687922.647826:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:1.0:1788687922.669935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687922.670382:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819758976 00000100:00100000:0.0:1788687922.670393:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819758976 00000100:00100000:0.0:1788687922.670454:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:0.0:1788687922.670464:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+6:13763:x1875574819758976:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788687922.670900:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+6:13763:x1875574819758976:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 436us (975us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788687922.670909:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:2.0:1788687922.674958:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687922.675143:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819759104 00000100:00100000:3.0:1788687922.675155:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819759104 00000100:00100000:3.0:1788687922.675217:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:3.0:1788687922.675229:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+6:13763:x1875574819759104:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788687922.675247:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687922.675266:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aace00/0xc2ddd83e7444a0df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462f17 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687922.675369:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aace00/0xc2ddd83e7444a0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f17 expref: 7 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687922.675384:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aace00/0xc2ddd83e7444a0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f17 expref: 7 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687922.675394:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aace00, rc 0) 00000100:00100000:3.0:1788687922.675562:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+7:13763:x1875574819759104:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 335us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687922.675569:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:2.0:1788687922.689733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687922.690373:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819759232 00000100:00100000:1.0:1788687922.690434:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819759232 00000100:00100000:1.0:1788687922.690575:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:1.0:1788687922.690595:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+7:13763:x1875574819759232:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788687922.690910:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+8:13763:x1875574819759232:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 317us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687922.690918:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:0.0:1788687922.697208:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687922.697332:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819759360 00000100:00100000:1.0:1788687922.697343:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819759360 00000100:00100000:0.0:1788687922.697564:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:0.0:1788687922.697586:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+8:13763:x1875574819759360:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788687922.698158:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+8:13763:x1875574819759360:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 581us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687922.698167:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:2.0:1788687922.701005:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687922.701331:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819759488 00000100:00100000:0.0:1788687922.701343:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819759488 00000100:00100000:0.0:1788687922.701597:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:0.0:1788687922.701608:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+8:13781:x1875574819759488:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788687922.702062:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+8:13781:x1875574819759488:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 453us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687922.702082:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:0.0:1788687922.720820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687922.723428:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819759616 00000100:00100000:2.0:1788687922.723445:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819759616 00000100:00100000:2.0:1788687922.723786:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:2.0:1788687922.723798:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+8:13781:x1875574819759616:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788687922.724956:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+8:13781:x1875574819759616:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 1155us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687922.726179:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:2.0:1788687922.731230:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687922.736226:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819759744 00000100:00100000:1.0:1788687922.736242:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819759744 00000100:00100000:1.0:1788687922.736334:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:1.0:1788687922.736345:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+8:13763:x1875574819759744:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788687922.736363:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687922.736382:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f38cda00/0xc2ddd83e7444a0e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462f41 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687922.736411:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f38cda00/0xc2ddd83e7444a0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f41 expref: 9 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687922.736423:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f38cda00/0xc2ddd83e7444a0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f41 expref: 9 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687922.736432:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cda00, rc 0) 00000100:00100000:1.0:1788687922.736530:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+9:13763:x1875574819759744:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 187us (5308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687922.736537:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:3.0:1788687922.742113:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687922.743036:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819759872 00000100:00100000:2.0:1788687922.743052:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819759872 00000100:00100000:2.0:1788687922.743134:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:2.0:1788687922.743146:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ed5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+9:13763:x1875574819759872:12345-192.168.204.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788687922.743185:0:14469:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788687922.743374:0:14469:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788687922.743378:0:14469:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788687922.743381:0:14469:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788687922.743384:0:14469:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788687922.747330:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ed5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+9:13763:x1875574819759872:12345-192.168.204.26@tcp:256:mount.lustre.0 Request processed in 4169us (5218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687922.747350:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:0.0:1788687922.751865:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687922.751992:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819760000 00000100:00100000:3.0:1788687922.752005:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819760000 00000100:00100000:3.0:1788687922.752076:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:3.0:1788687922.752088:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+9:13763:x1875574819760000:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788687922.752112:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687922.752137:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e7444a0ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462f48 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687922.752177:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e7444a0ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f48 expref: 10 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687922.752211:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e7444a0ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f48 expref: 10 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687922.752222:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aacc00, rc 0) 00000100:00100000:3.0:1788687922.752303:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+10:13763:x1875574819760000:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 217us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687922.752310:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:2.0:1788687922.755345:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687922.755462:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819760128 00000100:00100000:3.0:1788687922.755672:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819760128 00000100:00100000:3.0:1788687922.755791:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:3.0:1788687922.755825:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+10:13763:x1875574819760128:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788687922.756426:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+10:13763:x1875574819760128:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 603us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687922.756435:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:2.0:1788687922.760882:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687922.761078:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819760256 00000100:00100000:1.0:1788687922.761091:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819760256 00000100:00100000:1.0:1788687922.761176:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:1.0:1788687922.761188:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+10:13763:x1875574819760256:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788687922.761758:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+10:13763:x1875574819760256:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 570us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687922.761768:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:0.0:1788687922.767478:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687922.767777:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819760384 00000100:00100000:3.0:1788687922.767795:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819760384 00000100:00100000:3.0:1788687922.768569:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:3.0:1788687922.768596:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+10:13786:x1875574819760384:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788687922.768918:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+10:13786:x1875574819760384:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 327us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687922.773449:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687922.773631:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819760512 00000100:00100000:0.0:1788687922.773641:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819760512 00000100:00100000:3.0:1788687922.776880:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:0.0:1788687922.777703:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:0.0:1788687922.777722:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+10:13786:x1875574819760512:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788687922.778092:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+10:13786:x1875574819760512:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 376us (4650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687922.778101:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:2.0:1788687922.784955:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687922.785541:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819760640 00000100:00100000:1.0:1788687922.785559:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819760640 00000100:00100000:1.0:1788687922.785627:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:1.0:1788687922.785638:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2345:x1875574819760640:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788687922.785704:0:14478:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5@192.168.204.26@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1788687922.785775:0:14478:0:(genops.c:1385:class_connect()) connect: client cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5, cookie 0xc2ddd83e7444a0f4 00000004:00100000:1.0:1788687922.785820:0:14478:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788687922.785827:0:14478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788687922.890806:0:14478:0:(import.c:65:import_set_state_nolock()) ffff9af3fbbfe000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687922.890889:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:2345:x1875574819760640:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 105250us (105945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687922.890916:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:2.0:1788687922.898613:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687922.899717:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819760768 00000100:00100000:0.0:1788687922.899729:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819760768 00000100:00100000:0.0:1788687922.899820:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:0.0:1788687922.899832:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:0:x1875574819760768:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788687922.899877:0:14477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788687922.900053:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:0:x1875574819760768:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 223us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687922.900061:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00080000:1.0:1788687922.901503:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687922.914066:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687922.915433:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819760896 00000100:00100000:0.0:1788687922.915448:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819760896 00000100:00100000:0.0:1788687922.915565:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:0.0:1788687922.915590:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:13763:x1875574819760896:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788687922.915628:0:15887:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788687922.915726:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:13763:x1875574819760896:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 150us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687922.915748:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:3.0:1788687922.922768:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687922.923111:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819761024 00000100:00100000:0.0:1788687922.923122:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819761024 00000100:00100000:0.0:1788687922.923194:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788687922.923206:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:13763:x1875574819761024:12345-192.168.204.26@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788687922.923325:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:13763:x1875574819761024:12345-192.168.204.26@tcp:40:mount.lustre.0 Request processed in 121us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687922.923334:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788687922.933808:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687922.933851:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687922.933885:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687922.934098:0:15162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819761152 00000100:00100000:1.0:1788687922.934110:0:15162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819761152 00000100:00100000:1.0:1788687922.934159:0:15162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819761280 00000100:00100000:1.0:1788687922.934163:0:15162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819761280 00000100:00100000:1.0:1788687922.934186:0:15162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:1.0:1788687922.934194:0:15162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875574819761152:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788687922.934230:0:15162:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5@192.168.204.26@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1788687922.934268:0:15162:0:(genops.c:1385:class_connect()) connect: client cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5, cookie 0xc2ddd83e7444a0fb 00002000:00100000:1.0:1788687922.934281:0:15162:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5/ffff9af3fbbfe800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788687922.934315:0:15162:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788687922.934845:0:15162:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788687922.934879:0:15162:0:(import.c:65:import_set_state_nolock()) ffff9af3fbbfc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687922.935205:0:15162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:2345:x1875574819761152:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 1008us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687922.935214:0:15162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:1.0:1788687922.935239:0:15162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:1.0:1788687922.935261:0:15162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875574819761280:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788687922.935281:0:15162:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5@192.168.204.26@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1788687922.937103:0:15162:0:(genops.c:1385:class_connect()) connect: client cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5, cookie 0xc2ddd83e7444a102 00002000:00100000:1.0:1788687922.937123:0:15162:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5/ffff9af3d2b02800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788687922.937149:0:15162:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788687922.937649:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819761408 00000100:00100000:0.0:1788687922.937660:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819761408 00000100:00100000:0.0:1788687922.937717:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788687922.937727:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:13763:x1875574819761408:12345-192.168.204.26@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788687922.939536:0:14479:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1743us 00002000:00080000:1.0:1788687922.941856:0:15162:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788687922.941905:0:15162:0:(import.c:65:import_set_state_nolock()) ffff9af3ffbf2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687922.941976:0:15162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:2345:x1875574819761280:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 6712us (8088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687922.941988:0:15162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000004:00200000:3.0:1788687922.968170:0:14479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788687922.968295:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:13763:x1875574819761408:12345-192.168.204.26@tcp:33:mount.lustre.0 Request processed in 30563us (34493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687922.968309:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00010000:00010000:1.0:1788687923.013720:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687923.152957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687923.153136:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819761536 00000100:00100000:0.0:1788687923.153153:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819761536 00000100:00100000:0.0:1788687923.153345:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:0.0:1788687923.153357:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:13807:x1875574819761536:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:0.0:1788687923.153380:0:15887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687923.153408:0:15887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a109 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462f72 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687923.156209:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a110 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687923.156236:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687923.156274:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687923.156325:0:15887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788687923.156330:0:15887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687923.156375:0:15887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687923.156412:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a109 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f72 expref: 8 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687923.156436:0:15887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a110 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f72 expref: 7 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687923.156444:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687923.156447:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687923.156450:0:15887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79eca00, rc 0) 00000100:00100000:0.0:1788687923.156575:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+7:13807:x1875574819761536:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 3220us (3634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687923.156584:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000001:00100000:1.0:1788687923.316321:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5 00010000:00010000:3.0:1788687924.038729:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687925.027212:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687925.027674:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819761664 00000100:00100000:2.0:1788687925.027686:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819761664 00000100:00100000:2.0:1788687925.027772:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:2.0:1788687925.027783:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+7:13860:x1875574819761664:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1788687925.027827:0:14477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788687925.027939:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+7:13860:x1875574819761664:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 156us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687925.027946:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00080000:1.0:1788687925.028034:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687925.031236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687925.031366:0:15163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819761792 00000100:00100000:1.0:1788687925.031380:0:15163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819761792 00000100:00100000:1.0:1788687925.031522:0:15163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:1.0:1788687925.031536:0:15163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:13860:x1875574819761792:12345-192.168.204.26@tcp:13:lfs.0 00000100:00080000:0.0:1788687925.031622:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788687925.031704:0:15163:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687925.031830:0:15163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:13860:x1875574819761792:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 297us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687925.031839:0:15163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788687925.033756:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687925.033928:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819761920 00000100:00100000:2.0:1788687925.033940:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819761920 00000100:00100000:2.0:1788687925.034018:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:2.0:1788687925.034031:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:13860:x1875574819761920:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:2.0:1788687925.034074:0:15164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788687925.034193:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:13860:x1875574819761920:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 165us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687925.034201:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00080000:0.0:1788687925.034286:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788687925.062230:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788687925.190746:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687925.190898:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819762048 00000100:00100000:2.0:1788687925.190913:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819762048 00000100:00100000:2.0:1788687925.191087:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:2.0:1788687925.191100:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+10:13892:x1875574819762048:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788687925.191123:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687925.191147:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f4b4c400/0xc2ddd83e7444a117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462f79 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687925.191186:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f4b4c400/0xc2ddd83e7444a117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f79 expref: 11 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687925.191201:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f4b4c400/0xc2ddd83e7444a117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f79 expref: 11 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687925.191211:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f4b4c400, rc 0) 00000100:00100000:2.0:1788687925.191292:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13892:x1875574819762048:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 195us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687925.191300:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:3.0:1788687925.196189:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687925.196373:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819762176 00000100:00100000:1.0:1788687925.196388:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819762176 00000100:00100000:1.0:1788687925.196473:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:1.0:1788687925.196536:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13892:x1875574819762176:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788687925.197012:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13892:x1875574819762176:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 527us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687925.197031:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:3.0:1788687925.199730:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687925.199925:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819762304 00000100:00100000:0.0:1788687925.199940:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819762304 00000100:00100000:0.0:1788687925.200030:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:0.0:1788687925.200044:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13892:x1875574819762304:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788687925.200358:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13892:x1875574819762304:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 317us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687925.200374:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:3.0:1788687925.223633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687925.223927:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819762432 00000100:00100000:2.0:1788687925.223941:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819762432 00000100:00100000:2.0:1788687925.224009:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:2.0:1788687925.224022:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13899:x1875574819762432:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788687925.224394:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13899:x1875574819762432:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 373us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687925.224413:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:3.0:1788687925.249006:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687925.249609:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819762560 00000100:00100000:1.0:1788687925.249624:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819762560 00000100:00100000:1.0:1788687925.249704:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:1.0:1788687925.249718:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13899:x1875574819762560:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788687925.250152:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13899:x1875574819762560:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 436us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687925.250161:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:3.0:1788687925.254926:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687925.255031:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819762688 00000100:00100000:2.0:1788687925.255047:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819762688 00000100:00100000:2.0:1788687925.255129:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 95 00000100:00100000:2.0:1788687925.255141:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13892:x1875574819762688:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788687925.255168:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687925.255194:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f4b4de00/0xc2ddd83e7444a11e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462fa3 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687925.255236:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f4b4de00/0xc2ddd83e7444a11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fa3 expref: 12 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687925.255248:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f4b4de00/0xc2ddd83e7444a11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fa3 expref: 12 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687925.255260:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f4b4de00, rc 0) 00000100:00100000:2.0:1788687925.255342:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:13892:x1875574819762688:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 202us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687925.255350:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 95 00000100:00100000:3.0:1788687925.272610:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687925.273201:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819762816 00000100:00100000:1.0:1788687925.273217:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819762816 00000100:00100000:1.0:1788687925.273294:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 96 00000100:00100000:1.0:1788687925.273306:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:13892:x1875574819762816:12345-192.168.204.26@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788687925.273343:0:14471:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788687925.273367:0:14471:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788687925.273372:0:14471:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788687925.273376:0:14471:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788687925.273379:0:14471:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788687925.278354:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:13892:x1875574819762816:12345-192.168.204.26@tcp:256:mount.lustre.0 Request processed in 5029us (5740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687925.278376:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 96 00000100:00100000:3.0:1788687925.284564:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687925.284737:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819762944 00000100:00100000:0.0:1788687925.284753:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819762944 00000100:00100000:0.0:1788687925.284830:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:0.0:1788687925.284843:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:13892:x1875574819762944:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788687925.284867:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687925.284893:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f79ed800/0xc2ddd83e7444a125 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462faa expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687925.284949:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f79ed800/0xc2ddd83e7444a125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462faa expref: 13 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687925.284963:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f79ed800/0xc2ddd83e7444a125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462faa expref: 13 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687925.284973:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed800, rc 0) 00000100:00100000:0.0:1788687925.285753:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13892:x1875574819762944:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 905us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687925.285764:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:3.0:1788687925.296619:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687925.296799:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819763072 00000100:00100000:1.0:1788687925.296813:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819763072 00000100:00100000:1.0:1788687925.296883:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 98 00000100:00100000:1.0:1788687925.296898:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13892:x1875574819763072:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788687925.297397:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13892:x1875574819763072:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 500us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687925.297407:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 98 00000100:00100000:3.0:1788687925.300592:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687925.302591:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819763200 00000100:00100000:2.0:1788687925.302611:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819763200 00000100:00100000:2.0:1788687925.303091:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 99 00000100:00100000:2.0:1788687925.303106:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c698e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13892:x1875574819763200:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788687925.304167:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c698e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13892:x1875574819763200:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 1058us (3585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687925.304179:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 99 00000100:00100000:3.0:1788687925.310017:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687925.310827:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819763328 00000100:00100000:0.0:1788687925.311318:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819763328 00000100:00100000:0.0:1788687925.311530:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:0.0:1788687925.311544:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13903:x1875574819763328:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788687925.312166:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13903:x1875574819763328:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 621us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687925.312181:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:1.0:1788687925.320645:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687925.320783:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819763456 00000100:00100000:2.0:1788687925.320797:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819763456 00000100:00100000:2.0:1788687925.320877:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:2.0:1788687925.320889:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13903:x1875574819763456:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788687925.321229:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13903:x1875574819763456:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 341us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687925.321239:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:3.0:1788687925.329249:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687925.329765:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819763584 00000100:00100000:2.0:1788687925.329781:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819763584 00000100:00100000:2.0:1788687925.329862:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:2.0:1788687925.329872:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2345:x1875574819763584:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788687925.329909:0:14478:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3202fde6-7dbc-4316-b24e-66eae298a466@192.168.204.26@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1788687925.329973:0:14478:0:(genops.c:1385:class_connect()) connect: client 3202fde6-7dbc-4316-b24e-66eae298a466, cookie 0xc2ddd83e7444a12c 00000004:00100000:2.0:1788687925.330017:0:14478:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788687925.330179:0:14478:0:(import.c:65:import_set_state_nolock()) ffff9af2c2101000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788687925.330284:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3202fde6-7dbc-4316-b24e-66eae298a466+6:2345:x1875574819763584:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 411us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687925.330293:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:3.0:1788687925.338591:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687925.338633:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687925.338720:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819763840 00000100:00100000:0.0:1788687925.338735:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819763840 00000100:00100000:0.0:1788687925.338831:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819763712 00000100:00100000:0.0:1788687925.338835:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819763712 00000100:00100000:0.0:1788687925.338871:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788687925.338884:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3202fde6-7dbc-4316-b24e-66eae298a466+7:13892:x1875574819763840:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788687925.338959:0:14477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788687925.339045:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3202fde6-7dbc-4316-b24e-66eae298a466+7:13892:x1875574819763840:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 164us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687925.339053:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788687925.339075:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:0.0:1788687925.339081:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3202fde6-7dbc-4316-b24e-66eae298a466+6:0:x1875574819763712:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788687925.339092:0:14477:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788687925.339114:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3202fde6-7dbc-4316-b24e-66eae298a466+6:0:x1875574819763712:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 34us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687925.339120:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00080000:3.0:1788687925.339547:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687925.349105:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687925.349599:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819763968 00000100:00100000:0.0:1788687925.349613:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819763968 00000100:00100000:0.0:1788687925.349685:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788687925.349698:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3202fde6-7dbc-4316-b24e-66eae298a466+6:13892:x1875574819763968:12345-192.168.204.26@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788687925.349815:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3202fde6-7dbc-4316-b24e-66eae298a466+6:13892:x1875574819763968:12345-192.168.204.26@tcp:40:mount.lustre.0 Request processed in 119us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687925.349823:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:3.0:1788687925.357740:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687925.357838:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687925.357886:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687925.358413:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819764096 00000100:00100000:1.0:1788687925.358438:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819764096 00000100:00100000:1.0:1788687925.358509:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819764224 00000100:00100000:1.0:1788687925.358513:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819764224 00000100:00100000:1.0:1788687925.358539:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:1.0:1788687925.358549:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875574819764096:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788687925.358590:0:15159:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3202fde6-7dbc-4316-b24e-66eae298a466@192.168.204.26@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1788687925.358634:0:15159:0:(genops.c:1385:class_connect()) connect: client 3202fde6-7dbc-4316-b24e-66eae298a466, cookie 0xc2ddd83e7444a133 00002000:00100000:1.0:1788687925.358651:0:15159:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3202fde6-7dbc-4316-b24e-66eae298a466/ffff9af3ffbf3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788687925.358667:0:15159:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788687925.359088:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:3.0:1788687925.359096:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875574819764224:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788687925.359118:0:15160:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3202fde6-7dbc-4316-b24e-66eae298a466@192.168.204.26@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:3.0:1788687925.359141:0:15160:0:(genops.c:1385:class_connect()) connect: client 3202fde6-7dbc-4316-b24e-66eae298a466, cookie 0xc2ddd83e7444a13a 00002000:00100000:3.0:1788687925.359147:0:15160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3202fde6-7dbc-4316-b24e-66eae298a466/ffff9af3f7a06800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788687925.359155:0:15160:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788687925.359350:0:15160:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788687925.359393:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9af3f7a07800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788687925.359528:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3202fde6-7dbc-4316-b24e-66eae298a466+6:2345:x1875574819764224:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 429us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687925.359536:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00002000:00080000:1.0:1788687925.359804:0:15159:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788687925.359827:0:15159:0:(import.c:65:import_set_state_nolock()) ffff9af3c30f6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788687925.359871:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3202fde6-7dbc-4316-b24e-66eae298a466+6:2345:x1875574819764096:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 1322us (2032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687925.359880:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788687925.366322:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819764352 00000100:00100000:2.0:1788687925.366346:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819764352 00000001:00100000:1.0:1788687925.366499:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5 00000100:00100000:2.0:1788687925.366722:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:2.0:1788687925.366736:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3202fde6-7dbc-4316-b24e-66eae298a466+6:13892:x1875574819764352:12345-192.168.204.26@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788687925.366863:0:14480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788687925.367020:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3202fde6-7dbc-4316-b24e-66eae298a466+6:13892:x1875574819764352:12345-192.168.204.26@tcp:33:mount.lustre.0 Request processed in 287us (9298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687925.367052:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:3.0:1788687925.563460:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687925.564124:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819764480 00000100:00100000:0.0:1788687925.564140:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819764480 00000100:00100000:0.0:1788687925.564218:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:0.0:1788687925.564253:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3202fde6-7dbc-4316-b24e-66eae298a466+6:13924:x1875574819764480:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:0.0:1788687925.564284:0:15887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687925.564312:0:15887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a141 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462fd4 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687925.564410:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687925.564441:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687925.564459:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687925.564543:0:15887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788687925.564548:0:15887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687925.564573:0:15887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687925.564607:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a141 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fd4 expref: 8 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687925.564631:0:15887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fd4 expref: 7 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687925.564641:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687925.564645:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687925.564649:0:15887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79edc00, rc 0) 00000100:00100000:0.0:1788687925.564741:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3202fde6-7dbc-4316-b24e-66eae298a466+7:13924:x1875574819764480:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 491us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687925.564760:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00010000:00010000:3.0:1788687926.085695:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687926.342531:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af2c2a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77fc0cc6-2d57-47be-a26d-d352055b72d6:3312:1875574839675776:0@lo:400:kworker.0 00000100:00100000:1.0:1788687926.342649:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687926.342693:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839676032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687926.342722:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788687926.342728:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839675904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687926.342734:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687926.342750:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687926.342781:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839676032 00000100:00100000:0.0:1788687926.342792:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839676032 00000100:00100000:1.0:1788687926.342796:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839675776 00000100:00100000:1.0:1788687926.342799:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839675776 00000100:00100000:0.0:1788687926.342848:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839675904 00000100:00100000:0.0:1788687926.342851:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839675904 00000100:00100000:0.0:1788687926.342874:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788687926.342883:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839676032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687926.343150:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839676416:0@lo:400:kworker.0 00000100:00100000:3.0:1788687926.343191:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687926.343245:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788687926.343252:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839676288:0@lo:400:kworker.0 00000100:00100000:3.0:1788687926.343277:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687926.343316:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839676160:0@lo:400:kworker.0 00000100:00100000:3.0:1788687926.343418:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687926.343441:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788687926.343446:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839676544:0@lo:400:kworker.0 00000100:00100000:3.0:1788687926.343477:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788687926.343530:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788687926.343536:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788687926.343551:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839676416 00000100:00100000:3.0:1788687926.343556:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839676416 00000100:00100000:3.0:1788687926.343594:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839676288 00000100:00100000:3.0:1788687926.343597:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839676288 00000100:00100000:3.0:1788687926.343611:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839676544 00000100:00100000:3.0:1788687926.343614:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839676544 00000100:00100000:3.0:1788687926.343630:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788687926.343637:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839676416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687926.343698:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875574839676416:12345-0@lo:400:kworker.0 Request processed in 60us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687926.343706:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788687926.343735:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788687926.343742:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839676288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687926.343773:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875574839676288:12345-0@lo:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687926.343780:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00000024:0.0:1788687926.343780:0:15164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788687926.343794:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788687926.343802:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839676544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687926.343837:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839676032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 953us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687926.343846:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788687926.343863:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839676544:12345-0@lo:400:kworker.0 Request processed in 60us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687926.343868:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788687926.343874:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788687926.343881:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839675904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788687926.343905:0:15164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687926.343937:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839675904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687926.343944:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788687926.343994:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839676032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788687926.344048:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839675904:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788687926.344078:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788687926.344117:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875574839676288:0@lo:400:kworker.0 00000100:00100000:0.0:1788687926.344129:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875574839676416:0@lo:400:kworker.0 00000100:00100000:2.0:1788687926.344170:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839676544:0@lo:400:kworker.0 00000100:00100000:3.0:1788687926.344223:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839676160 00000100:00100000:3.0:1788687926.344228:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839676160 00000100:00100000:1.0:1788687926.344425:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788687926.344430:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788687926.344435:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:3312:x1875574839675776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687926.344436:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839676160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687926.344477:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875574839676160:12345-0@lo:400:kworker.0 Request processed in 40us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687926.344477:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:3312:x1875574839675776:12345-0@lo:400:kworker.0 Request processed in 44us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687926.344498:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788687926.344531:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875574839676160:0@lo:400:kworker.0 00000100:00100000:1.0:1788687926.344538:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af2c2a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77fc0cc6-2d57-47be-a26d-d352055b72d6:3312:1875574839675776:0@lo:400:kworker.0 00000100:00100000:3.0:1788687926.344590:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788687927.110615:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788687927.907646:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5 00000001:00100000:3.0:1788687927.907663:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3202fde6-7dbc-4316-b24e-66eae298a466 00010000:00010000:3.0:1788687928.138432:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788687928.432761:0:16446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788687928.464435:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3202fde6-7dbc-4316-b24e-66eae298a466 00010000:00010000:1.0:1788687929.159205:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788687930.184042:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788687930.509061:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3202fde6-7dbc-4316-b24e-66eae298a466 00000100:00100000:3.0:1788687930.858388:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687930.858456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687930.858457:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819764608 00000100:00100000:3.0:1788687930.858544:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687930.858762:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819764608 00000100:00100000:3.0:1788687930.858819:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687930.858892:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:0.0:1788687930.858904:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:2347:x1875574819764608:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687930.859181:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:2347:x1875574819764608:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 277us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687930.859189:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:0.0:1788687930.859242:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819764736 00000100:00100000:0.0:1788687930.859247:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819764736 00000100:00100000:0.0:1788687930.859277:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:0.0:1788687930.859282:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:2347:x1875574819764736:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788687930.859307:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:2347:x1875574819764736:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687930.859333:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00080000:0.0:1788687930.859351:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687930.860830:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687930.860936:0:15162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819764864 00000100:00100000:1.0:1788687930.860950:0:15162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819764864 00000100:00100000:3.0:1788687930.860977:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687930.861002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687930.861025:0:15162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819764992 00000100:00100000:3.0:1788687930.861029:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819765248 00000100:00100000:1.0:1788687930.861029:0:15162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819764992 00000100:00100000:3.0:1788687930.861032:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819765248 00000100:00100000:1.0:1788687930.861049:0:15162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819765376 00000100:00100000:1.0:1788687930.861051:0:15162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819765376 00000100:00100000:3.0:1788687930.861056:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:3.0:1788687930.861070:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:2346:x1875574819764864:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687930.861073:0:15162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:1.0:1788687930.861081:0:15162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:2347:x1875574819764992:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687930.861155:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:2346:x1875574819764864:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 90us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687930.861155:0:15162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:2347:x1875574819764992:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 73us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687930.861165:0:15162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:3.0:1788687930.861175:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:1.0:1788687930.861187:0:15162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788687930.861191:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:1.0:1788687930.861193:0:15162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3202fde6-7dbc-4316-b24e-66eae298a466+5:2347:x1875574819765248:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788687930.861197:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3202fde6-7dbc-4316-b24e-66eae298a466+5:2346:x1875574819765376:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687930.861219:0:15162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3202fde6-7dbc-4316-b24e-66eae298a466+5:2347:x1875574819765248:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687930.861220:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3202fde6-7dbc-4316-b24e-66eae298a466+5:2346:x1875574819765376:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 24us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687930.861226:0:15162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788687930.861239:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:3.0:1788687930.861258:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819765120 00000100:00100000:3.0:1788687930.861261:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819765120 00000100:00100000:3.0:1788687930.861296:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:3.0:1788687930.861302:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3202fde6-7dbc-4316-b24e-66eae298a466+6:2346:x1875574819765120:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:0.0:1788687930.861524:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788687930.861531:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788687930.861533:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788687930.862995:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3202fde6-7dbc-4316-b24e-66eae298a466+6:2346:x1875574819765120:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1679us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687930.863011:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00010000:00010000:1.0:1788687931.210386:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687931.461990:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788687931.462023:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839676672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687931.462129:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687931.462221:0:15163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839676672 00000100:00100000:0.0:1788687931.462231:0:15163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839676672 00000100:00100000:0.0:1788687931.462317:0:15163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788687931.462327:0:15163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839676672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788687931.462377:0:15163:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788687931.462448:0:15163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839676672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687931.462455:0:15163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788687931.462504:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788687931.462555:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839676672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687931.462738:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788687931.462750:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839676800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687931.462787:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687931.462820:0:15163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839676800 00000100:00100000:1.0:1788687931.462825:0:15163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839676800 00000100:00100000:1.0:1788687931.462860:0:15163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788687931.462870:0:15163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839676800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687931.462897:0:15163:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687931.462930:0:15163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839676800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687931.462937:0:15163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788687931.462956:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788687931.462977:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839676800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788687931.466138:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839677184:0@lo:400:kworker.0 00000100:00100000:3.0:1788687931.466324:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687931.466388:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788687931.466396:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839677056:0@lo:400:kworker.0 00000100:00100000:3.0:1788687931.466422:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687931.466468:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839677184 00000100:00100000:3.0:1788687931.467318:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839677184 00000100:00100000:3.0:1788687931.467407:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839677056 00000100:00100000:3.0:1788687931.467412:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839677056 00000100:00100000:3.0:1788687931.467441:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788687931.467452:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839677184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687931.468531:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839676928:0@lo:400:kworker.0 00000100:00100000:1.0:1788687931.468614:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687931.468675:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788687931.468684:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839677312:0@lo:400:kworker.0 00000100:00100000:1.0:1788687931.468730:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687931.468766:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839676928 00000100:00100000:1.0:1788687931.468773:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839676928 00000100:00100000:2.0:1788687931.468817:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839677312 00000100:00100000:1.0:1788687931.468827:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788687931.468836:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:3313:x1875574839676928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687931.468850:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839677184:12345-0@lo:400:kworker.0 Request processed in 1276us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687931.468875:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:3313:x1875574839676928:12345-0@lo:400:kworker.0 Request processed in 40us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687931.468882:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788687931.468928:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788687931.468955:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788687931.468959:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839676928:0@lo:400:kworker.0 00000100:00100000:3.0:1788687931.468967:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839677056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687931.469008:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875574839677056:12345-0@lo:400:kworker.0 Request processed in 45us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687931.469014:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788687931.469139:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875574839677056:0@lo:400:kworker.0 00000100:00100000:3.0:1788687931.469153:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839677184:0@lo:400:kworker.0 00000100:00080000:3.0:1788687931.469189:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788687931.469376:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839677312 00000100:00100000:2.0:1788687931.469560:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788687931.469569:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839677312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788687931.469628:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875574839677312:12345-0@lo:400:kworker.0 Request processed in 60us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687931.469635:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788687931.469678:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875574839677312:0@lo:400:kworker.0 00000100:00080000:3.0:1788687931.470146:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1788687931.544092:0:16597:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8bc5cc30 20000000:00000080:1.0:1788687931.544112:0:16597:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af2c2fc8000 uarg=0000000000000000 20000000:01000000:1.0:1788687931.544148:0:16597:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788687931.544155:0:16597:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788687931.544160:0:16597:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788687931.551598:0:16598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788687931.552079:0:16597:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788687931.560944:0:16597:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788687931.560988:0:16597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.561015:0:16597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3f15d3000/0xc2ddd83e74449e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449e3f expref: 18 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.561025:0:16597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449e8c expref: 18 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.561032:0:16597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74449f03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e74449efc expref: 18 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.561044:0:16597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e7444a0ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f48 expref: 12 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.561051:0:16597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af3f79ed800/0xc2ddd83e7444a125 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462faa expref: 12 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.561060:0:16597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.561122:0:16597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3f79ed800/0xc2ddd83e7444a125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462faa expref: 12 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.561167:0:16597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3f79ed800/0xc2ddd83e7444a125 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462faa expref: 12 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687931.561188:0:16597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1875574839677440:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687931.561888:0:16597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e7444a0ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f48 expref: 12 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.561899:0:16597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e7444a0ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f48 expref: 12 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687931.561910:0:16597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1875574839677568:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687931.561963:0:16597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74449f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74449efc expref: 18 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.561972:0:16597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74449f03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74449efc expref: 18 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687931.561981:0:16597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1875574839677696:0@lo:104: 00000100:00100000:0.0:1788687931.562025:0:16597:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788687931.562074:0:16597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74449e8c expref: 18 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.562084:0:16597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74449e8c expref: 18 pid: 14471 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687931.562094:0:16597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1875574839677824:0@lo:104: 00000100:00100000:0.0:1788687931.562117:0:16597:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788687931.562160:0:16597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af3f15d3000/0xc2ddd83e74449e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2ddd83e74449e3f expref: 18 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.562168:0:16597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af3f15d3000/0xc2ddd83e74449e46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2ddd83e74449e3f expref: 18 pid: 14469 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687931.562184:0:16597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c52a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1875574839677952:0@lo:104: 00000100:00100000:0.0:1788687931.562209:0:16597:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687931.562223:0:16597:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce240 going to sleep for 11 seconds 00000100:00100000:3.0:1788687931.562445:0:15890:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788687931.562583:0:15890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839677696 00000100:00100000:3.0:1788687931.562595:0:15890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839677696 00000100:00100000:3.0:1788687931.562657:0:15890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839677824 00000100:00100000:3.0:1788687931.562662:0:15890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839677824 00000100:00100000:3.0:1788687931.562674:0:15890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839677952 00000100:00100000:3.0:1788687931.562677:0:15890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839677952 00000100:00100000:3.0:1788687931.562695:0:15890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788687931.562705:0:15890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:77fc0cc6-2d57-47be-a26d-d352055b72d6+5:16597:x1875574839677696:12345-0@lo:104: 00010000:00010000:3.0:1788687931.562725:0:15890:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687931.562825:0:15890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788687931.562832:0:15890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:77fc0cc6-2d57-47be-a26d-d352055b72d6+5:16597:x1875574839677696:12345-0@lo:104: Request processed in 129us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687931.564276:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788687931.564307:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77fc0cc6-2d57-47be-a26d-d352055b72d6+5:16597:x1875574839677824:12345-0@lo:104: 00010000:00010000:2.0:1788687931.564324:0:14460:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564401:0:14460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788687931.564407:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77fc0cc6-2d57-47be-a26d-d352055b72d6+5:16597:x1875574839677824:12345-0@lo:104: Request processed in 120us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687931.564414:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788687931.564440:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788687931.564446:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f7954050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77fc0cc6-2d57-47be-a26d-d352055b72d6+4:16597:x1875574839677952:12345-0@lo:104: 00010000:00010000:2.0:1788687931.564454:0:14460:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564524:0:14460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788687931.564530:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f7954050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77fc0cc6-2d57-47be-a26d-d352055b72d6+4:16597:x1875574839677952:12345-0@lo:104: Request processed in 84us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687931.564536:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788687931.564556:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788687931.564563:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564572:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd200 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687931.564576:0:14464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564585:0:14464:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687931.564593:0:14464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687931.564598:0:14464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788687931.564639:0:14464:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564646:0:14464:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687931.564668:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564675:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3f38cd200/0xc2ddd83e74449efc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449f03 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564702:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788687931.564705:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564711:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc600 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687931.564714:0:14464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564722:0:14464:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687931.564729:0:14464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687931.564735:0:14464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788687931.564748:0:14464:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564754:0:14464:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687931.564770:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564776:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc600/0xc2ddd83e74449e8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449e93 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564787:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788687931.564790:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564804:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc000 already unused, calling callback (ffffffffc1c0bc20) 10000000:00010000:2.0:1788687931.564808:0:14464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564814:0:14464:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788687931.564820:0:14464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788687931.564825:0:14464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788687931.564840:0:14464:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564846:0:14464:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788687931.564852:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564858:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9af3f38cc000/0xc2ddd83e74449e3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2ddd83e74449e46 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.564872:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687931.564874:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788687931.564875:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788687931.564897:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839678080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788687931.564940:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687931.565011:0:16597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1875574839677696:0@lo:104: 00000100:00100000:2.0:1788687931.565013:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839678208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687931.565038:0:16597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1875574839677824:0@lo:104: 00000100:00100000:0.0:1788687931.565059:0:16597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c52a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1875574839677952:0@lo:104: 00000100:00100000:2.0:1788687931.565069:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687931.565108:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788687931.565117:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839678336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788687931.565147:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839678080 00000100:00100000:2.0:1788687931.565154:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687931.565158:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839678080 00000100:00100000:2.0:1788687931.565192:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839678208 00000100:00100000:2.0:1788687931.565203:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839678208 00010000:00010000:0.0:1788687931.565209:0:14462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74449f03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449efc expref: 20 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.565234:0:14461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449e8c expref: 20 pid: 14471 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687931.565255:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839678336 00000100:00100000:0.0:1788687931.565261:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839678336 00000100:00100000:2.0:1788687931.565268:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788687931.565278:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+21:3313:x1875574839678080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788687931.565284:0:14462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3f15d3000/0xc2ddd83e74449e46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449e3f expref: 21 pid: 14469 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.565293:0:14461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788687931.565316:0:14462:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788687931.565317:0:14461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74449f03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449efc expref: 21 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687931.565333:0:14462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788687931.565338:0:14461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74449f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74449efc expref: 21 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.565357:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f38cc400/0xc2ddd83e74449f03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74449efc expref: 21 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687931.565362:0:14463:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788687931.565372:0:14461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687931.565377:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788687931.565390:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77fc0cc6-2d57-47be-a26d-d352055b72d6+20:3310:x1875574839678208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788687931.565405:0:14463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687931.565414:0:14463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449e8c expref: 20 pid: 14471 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687931.565416:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+20:3313:x1875574839678080:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687931.565446:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788687931.565465:0:14461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1788687931.565469:0:14463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74449e8c expref: 19 pid: 14471 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687931.565506:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788687931.565515:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fcd74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:3310:x1875574839678336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788687931.565525:0:14461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687931.565530:0:14461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3f15d3000/0xc2ddd83e74449e46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2ddd83e74449e3f expref: 19 pid: 14469 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687931.566556:0:15890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788687931.566704:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687931.566961:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:2.0:1788687931.569175:0:14461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3f15d3000/0xc2ddd83e74449e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2ddd83e74449e3f expref: 19 pid: 14469 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.569203:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f15d3000/0xc2ddd83e74449e46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74449e3f expref: 19 pid: 14469 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.569220:0:14461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687931.569348:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fcd74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:3310:x1875574839678336:12345-0@lo:103:ldlm_bl.0 Request processed in 3833us (4195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687931.569358:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788687931.569387:0:14461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788687931.569396:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819765504 00000100:00100000:2.0:1788687931.569403:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819765504 00010000:00010000:2.0:1788687931.569434:0:14461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3f79ed800/0xc2ddd83e7444a125 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462faa expref: 13 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687931.569450:0:14461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788687931.569468:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788687931.569477:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:2348:x1875574819765504:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687931.569505:0:14461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687931.569511:0:14461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3f79ed800/0xc2ddd83e7444a125 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462faa expref: 13 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.569523:0:14461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3f79ed800/0xc2ddd83e7444a125 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462faa expref: 13 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.569534:0:14461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687931.569573:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:2348:x1875574819765504:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 98us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687931.569588:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788687931.569633:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77fc0cc6-2d57-47be-a26d-d352055b72d6:3313:1875574839678080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788687931.570142:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839678336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788687931.570619:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f79ed800/0xc2ddd83e7444a125 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462faa expref: 12 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687931.570633:0:16597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1875574839677440:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687931.570644:0:16597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1875574839677568:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687931.570674:0:16597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.571357:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f79ec400/0xc2ddd83e74449e93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2ddd83e74449e8c expref: 17 pid: 14471 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.571386:0:14463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687931.571517:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:3310:x1875574839678208:12345-0@lo:103:ldlm_bl.0 Request processed in 6130us (6459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687931.571529:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788687931.571625:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77fc0cc6-2d57-47be-a26d-d352055b72d6:3310:1875574839678208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788687931.575406:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687931.575513:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819765632 00000100:00100000:2.0:1788687931.575524:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819765632 00010000:00010000:2.0:1788687931.575570:0:14461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e7444a0ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f48 expref: 12 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687931.575607:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788687931.575619:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:2349:x1875574819765632:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687931.575636:0:14461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687931.575642:0:14461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e7444a0ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f48 expref: 12 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575654:0:14461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e7444a0ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f48 expref: 12 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575674:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3e0aacc00/0xc2ddd83e7444a0ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f48 expref: 12 pid: 14470 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575730:0:14461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575738:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575756:0:14461:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575762:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575770:0:14461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575777:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575783:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ece00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687931.575787:0:14461:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575796:0:14461:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575814:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687931.575827:0:14461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687931.575880:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:2349:x1875574819765632:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 263us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687931.575894:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00010000:00010000:0.0:1788687931.576037:0:16597:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.576056:0:16597:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687931.576064:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af3f79ece00/0xc2ddd83e7444a14f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687932.230682:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788687932.486404:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788687933.098185:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687933.098314:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819765760 00000100:00100000:0.0:1788687933.098325:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819765760 00000100:00100000:0.0:1788687933.098386:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 105 00000100:00100000:0.0:1788687933.098397:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+11:13777:x1875574819765760:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788687933.098414:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687933.098436:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f79ec800/0xc2ddd83e7444a156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462fdb expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687933.098464:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f79ec800/0xc2ddd83e7444a156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fdb expref: 12 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687933.098510:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f79ec800/0xc2ddd83e7444a156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fdb expref: 12 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687933.098521:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec800, rc 0) 00000100:00100000:0.0:1788687933.098576:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:13777:x1875574819765760:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 181us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687933.098583:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 105 00000100:00100000:3.0:1788687933.101995:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687933.102037:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819765888 00000100:00100000:3.0:1788687933.102046:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819765888 00000100:00100000:3.0:1788687933.102094:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:3.0:1788687933.102105:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:13777:x1875574819765888:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687933.102441:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:13777:x1875574819765888:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 337us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687933.102450:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:2.0:1788687933.107445:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687933.107552:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819766016 00000100:00100000:3.0:1788687933.107562:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819766016 00000100:00100000:3.0:1788687933.107618:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:3.0:1788687933.107629:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:13777:x1875574819766016:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687933.107933:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:13777:x1875574819766016:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 304us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687933.107942:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:3.0:1788687933.118289:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687933.118404:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819766144 00000100:00100000:2.0:1788687933.118414:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819766144 00000100:00100000:2.0:1788687933.118466:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:2.0:1788687933.118477:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+12:13777:x1875574819766144:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687933.118522:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687933.118543:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f4b4c200/0xc2ddd83e7444a15d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa2de35943462fe2 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687933.118583:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f4b4c200/0xc2ddd83e7444a15d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fe2 expref: 13 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687933.118596:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f4b4c200/0xc2ddd83e7444a15d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fe2 expref: 13 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687933.118605:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f4b4c200, rc 0) 00000100:00100000:2.0:1788687933.118660:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13777:x1875574819766144:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 185us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687933.118668:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:0.0:1788687933.128561:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687933.129507:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819766272 00000100:00100000:2.0:1788687933.129518:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819766272 00000100:00100000:2.0:1788687933.129570:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:2.0:1788687933.129580:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13777:x1875574819766272:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687933.129900:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13777:x1875574819766272:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 320us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687933.129918:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:0.0:1788687933.133787:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687933.134173:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819766400 00000100:00100000:3.0:1788687933.134184:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819766400 00000100:00100000:3.0:1788687933.134242:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 110 00000100:00100000:3.0:1788687933.134253:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13777:x1875574819766400:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687933.134523:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:13777:x1875574819766400:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 271us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687933.134532:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 110 00010000:00010000:3.0:1788687933.257882:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788687933.381709:0:14473:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788687933.381720:0:14473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3c6a19800 from 10 10000000:01000000:2.0:1788687933.381726:0:14473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788687933.381796:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f4b4c000/0xc2ddd83e7444a164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687933.381808:0:14473:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f4b4c000/0xc2ddd83e7444a164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687933.381821:0:14473:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f4b4c000/0xc2ddd83e7444a164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687933.381851:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3416680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839678464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788687933.381931:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788687933.382006:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788687933.382223:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839678464 00000100:00100000:3.0:1788687933.382231:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839678464 00000100:00100000:3.0:1788687933.382301:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788687933.382311:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+16:14473:x1875574839678464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788687933.382327:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687933.382342:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aad000/0xc2ddd83e7444a16b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e7444a164 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687933.382367:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aad000/0xc2ddd83e7444a16b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e7444a164 expref: 17 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687933.382379:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aad000/0xc2ddd83e7444a16b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e7444a164 expref: 17 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687933.382387:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad000, rc 0) 00000100:00100000:3.0:1788687933.382441:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:14473:x1875574839678464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687933.382448:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788687933.382553:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3416680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839678464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788687933.382569:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f4b4c000/0xc2ddd83e7444a164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a16b expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687933.382587:0:14473:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f4b4c000/0xc2ddd83e7444a164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e7444a16b expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687933.382653:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c51c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839678592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687933.382682:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788687933.382711:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687933.382871:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839678592 00000100:00100000:2.0:1788687933.382875:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839678592 00000100:00100000:2.0:1788687933.382908:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788687933.382915:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:14473:x1875574839678592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687933.383183:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:14473:x1875574839678592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687933.383191:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788687933.383408:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c51c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839678592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788687933.383471:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c51c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839678720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687933.384313:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687933.384393:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3fb8ce3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687933.384830:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839678720 00000100:00100000:2.0:1788687933.384838:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839678720 00000100:00100000:2.0:1788687933.384925:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788687933.384935:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:14473:x1875574839678720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788687933.385141:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:14473:x1875574839678720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687933.385155:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788687933.385241:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c51c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839678720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788687933.386125:0:16707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788687933.387278:0:14473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788687933.387315:0:14473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788687933.387329:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f4b4c000/0xc2ddd83e7444a164 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a16b expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687933.387342:0:14473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f4b4c000/0xc2ddd83e7444a164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a16b expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687933.387355:0:14473:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788687933.387357:0:14473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af3c729e000 from 10 10000000:01000000:1.0:1788687933.387365:0:14473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687933.387404:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38ccc00/0xc2ddd83e7444a172 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687933.387412:0:14473:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38ccc00/0xc2ddd83e7444a172 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687933.387441:0:14473:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38ccc00/0xc2ddd83e7444a172 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687933.387469:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839678848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788687933.388056:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687933.388108:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c681c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687933.388307:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839678848 00000100:00100000:2.0:1788687933.388314:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839678848 00000100:00100000:2.0:1788687933.388414:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788687933.388425:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+17:14473:x1875574839678848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788687933.388440:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687933.388455:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3f4b4ca00/0xc2ddd83e7444a179 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e7444a172 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687933.388512:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3f4b4ca00/0xc2ddd83e7444a179 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e7444a172 expref: 18 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687933.388525:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3f4b4ca00/0xc2ddd83e7444a179 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e7444a172 expref: 18 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687933.388533:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f4b4ca00, rc 0) 00000100:00100000:2.0:1788687933.388650:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:14473:x1875574839678848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687933.388658:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788687933.388751:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839678848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687933.388768:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38ccc00/0xc2ddd83e7444a172 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a179 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687933.388777:0:14473:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38ccc00/0xc2ddd83e7444a172 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e7444a179 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687933.388835:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839678976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687933.388863:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687933.389075:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c681c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687933.389136:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839678976 00000100:00100000:3.0:1788687933.389142:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839678976 00000100:00100000:3.0:1788687933.389166:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788687933.389173:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ee591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:14473:x1875574839678976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788687933.389453:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ee591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:14473:x1875574839678976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687933.389460:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788687933.389554:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839678976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687933.389595:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839679104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687933.389634:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687933.389662:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c681c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687933.389825:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839679104 00000100:00100000:3.0:1788687933.389830:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839679104 00000100:00100000:3.0:1788687933.389856:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788687933.389862:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:14473:x1875574839679104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687933.390020:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:14473:x1875574839679104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687933.390027:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788687933.390967:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839679104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788687933.394195:0:16708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788687933.397017:0:14473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788687933.397058:0:14473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788687933.397071:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38ccc00/0xc2ddd83e7444a172 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a179 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687933.397102:0:14473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38ccc00/0xc2ddd83e7444a172 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a179 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788687933.397115:0:14473:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788687933.397118:0:14473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af2c1b98800 from 10 10000000:01000000:1.0:1788687933.397121:0:14473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788687933.397162:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cdc00/0xc2ddd83e7444a180 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687933.397170:0:14473:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9af3f38cdc00/0xc2ddd83e7444a180 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687933.397181:0:14473:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9af3f38cdc00/0xc2ddd83e7444a180 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687933.397207:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839679232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788687933.397373:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687933.397508:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c681c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687933.397709:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839679232 00000100:00100000:3.0:1788687933.397718:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839679232 00000100:00100000:3.0:1788687933.397869:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788687933.397892:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+18:14473:x1875574839679232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788687933.397907:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687933.397922:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af3e0aada00/0xc2ddd83e7444a187 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2ddd83e7444a180 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687933.397948:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af3e0aada00/0xc2ddd83e7444a187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2ddd83e7444a180 expref: 19 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687933.397959:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af3e0aada00/0xc2ddd83e7444a187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2ddd83e7444a180 expref: 19 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687933.397968:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aada00, rc 0) 00000100:00100000:3.0:1788687933.398024:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:14473:x1875574839679232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687933.398032:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788687933.398119:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839679232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788687933.398136:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9af3f38cdc00/0xc2ddd83e7444a180 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a187 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687933.398145:0:14473:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9af3f38cdc00/0xc2ddd83e7444a180 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2ddd83e7444a187 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687933.398202:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839679360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687933.398228:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687933.398859:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c681c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788687933.398964:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839679360 00000100:00100000:2.0:1788687933.398970:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839679360 00000100:00100000:2.0:1788687933.399139:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788687933.399149:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:14473:x1875574839679360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788687933.399596:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:14473:x1875574839679360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687933.399604:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788687933.399840:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839679360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788687933.399880:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839679488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788687933.399925:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687933.399993:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c681c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788687933.400102:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839679488 00000100:00100000:3.0:1788687933.400108:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839679488 00000100:00100000:3.0:1788687933.400180:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788687933.400189:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:14473:x1875574839679488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788687933.400366:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:14473:x1875574839679488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687933.400379:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788687933.400454:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3ffe38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77fc0cc6-2d57-47be-a26d-d352055b72d6:14473:1875574839679488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788687933.401749:0:16709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788687933.402038:0:14473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788687933.402058:0:14473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788687933.402070:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9af3f38cdc00/0xc2ddd83e7444a180 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a187 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687933.402083:0:14473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9af3f38cdc00/0xc2ddd83e7444a180 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2ddd83e7444a187 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.279337:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788687934.285705:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.285900:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819766528 00000100:00100000:3.0:1788687934.285911:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819766528 00000100:00100000:3.0:1788687934.286057:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00080000:1.0:1788687934.286064:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788687934.286076:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:14433:x1875574819766528:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687934.286098:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687934.286122:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a18e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462fe9 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286203:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a195 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286218:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286232:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286258:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a19c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286265:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a19c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286271:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a19c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286743:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac000/0xc2ddd83e7444a1a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286774:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac000/0xc2ddd83e7444a1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286782:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac000/0xc2ddd83e7444a1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687934.286809:0:14477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788687934.286813:0:14477:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687934.286850:0:14477:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac000/0xc2ddd83e7444a1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286862:0:14477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286868:0:14477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a195 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286875:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286881:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687934.286885:0:14477:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286893:0:14477:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a195 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286907:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687934.286910:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687934.286914:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286929:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286942:0:14477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a19c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286948:0:14477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a19c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286953:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a19c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286958:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687934.286961:0:14477:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a19c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286967:0:14477:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a19c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286975:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9af3ca87c200) 00010000:00010000:3.0:1788687934.286978:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687934.286981:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a19c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.286986:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a19c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.287019:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a18e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fe9 expref: 8 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.287043:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac000/0xc2ddd83e7444a1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fe9 expref: 7 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.287050:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:3.0:1788687934.287052:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788687934.287054:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac000, rc 0) 00000100:00100000:3.0:1788687934.287124:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+7:14433:x1875574819766528:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1054us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687934.287133:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:3.0:1788687934.290570:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687934.291653:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819766784 00000100:00100000:2.0:1788687934.291667:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819766784 00000100:00100000:2.0:1788687934.291735:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:2.0:1788687934.291746:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+7:14433:x1875574819766784:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788687934.291764:0:15887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687934.291788:0:15887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4da00/0xc2ddd83e7444a1aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ff0 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.291868:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4dc00/0xc2ddd83e7444a1b1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.291882:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4dc00/0xc2ddd83e7444a1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.291895:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4dc00/0xc2ddd83e7444a1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.291910:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4cc00/0xc2ddd83e7444a1b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.291922:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4cc00/0xc2ddd83e7444a1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.291947:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4cc00/0xc2ddd83e7444a1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292328:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d000/0xc2ddd83e7444a1bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292338:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d000/0xc2ddd83e7444a1bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292346:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d000/0xc2ddd83e7444a1bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687934.292355:0:15887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788687934.292582:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4dc00/0xc2ddd83e7444a1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292591:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4dc00/0xc2ddd83e7444a1b1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292597:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4dc00/0xc2ddd83e7444a1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292603:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4dc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687934.292608:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4dc00/0xc2ddd83e7444a1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292616:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4dc00/0xc2ddd83e7444a1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292628:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9af3ca87c400) 00010000:00010000:2.0:1788687934.292631:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687934.292641:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4dc00/0xc2ddd83e7444a1b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292648:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4dc00/0xc2ddd83e7444a1b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292661:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4cc00/0xc2ddd83e7444a1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292667:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4cc00/0xc2ddd83e7444a1b8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292672:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4cc00/0xc2ddd83e7444a1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292677:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4cc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:2.0:1788687934.292680:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4cc00/0xc2ddd83e7444a1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292686:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4cc00/0xc2ddd83e7444a1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292693:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9af3c7f7c700) 00010000:00010000:2.0:1788687934.292696:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687934.292698:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4cc00/0xc2ddd83e7444a1b8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.292703:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4cc00/0xc2ddd83e7444a1b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.293149:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4da00/0xc2ddd83e7444a1aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ff0 expref: 10 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.293175:0:15887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d000/0xc2ddd83e7444a1bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ff0 expref: 9 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.293182:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3c7f7ca00) 00010000:00010000:2.0:1788687934.293184:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788687934.293186:0:15887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f4b4d000, rc 0) 00000100:00100000:2.0:1788687934.293545:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:14433:x1875574819766784:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1799us (2982us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788687934.293553:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:0.0:1788687934.299274:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.299548:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819766912 00000100:00100000:3.0:1788687934.299560:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819766912 00000100:00100000:3.0:1788687934.299905:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:3.0:1788687934.299916:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:14433:x1875574819766912:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788687934.300109:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:14433:x1875574819766912:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 195us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687934.300116:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:3.0:1788687934.347076:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687934.347946:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819767040 00000100:00100000:1.0:1788687934.347958:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819767040 00000100:00100000:1.0:1788687934.348030:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:1.0:1788687934.348042:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:14439:x1875574819767040:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788687934.348065:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687934.348093:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444a1cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ff7 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348161:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a1d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348177:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348192:0:14478:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348208:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a1db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348231:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a1db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348238:0:14478:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a1db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348454:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348463:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a1d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348469:0:14478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348475:0:14478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687934.348515:0:14478:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348525:0:14478:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a1d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348539:0:14478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:1.0:1788687934.348542:0:14478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687934.348546:0:14478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a1d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348552:0:14478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a1d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348565:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a1db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348580:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a1db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348586:0:14478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a1db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348590:0:14478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687934.348594:0:14478:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a1db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348600:0:14478:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a1db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348607:0:14478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9af3c7fb4c00) 00010000:00010000:1.0:1788687934.348610:0:14478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687934.348613:0:14478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a1db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348618:0:14478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a1db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348653:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444a1cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ff7 expref: 10 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348663:0:14478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:1.0:1788687934.348665:0:14478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687934.348669:0:14478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444a1cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ff7 expref: 10 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.348690:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc000, rc 0) 00000100:00100000:1.0:1788687934.351872:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:14439:x1875574819767040:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 723us (1696us total) trans 0 rc 301/301 00000100:00100000:1.0:1788687934.351897:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:1.0:1788687934.357067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.357169:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819767168 00000100:00100000:3.0:1788687934.357180:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819767168 00000100:00100000:3.0:1788687934.357296:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:3.0:1788687934.357308:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:14439:x1875574819767168:12345-192.168.204.26@tcp:700:lfs.0 00000100:00100000:3.0:1788687934.357400:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:14439:x1875574819767168:12345-192.168.204.26@tcp:700:lfs.0 Request processed in 94us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687934.357425:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788687934.363190:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.363278:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819767424 00000100:00100000:3.0:1788687934.363288:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819767424 00000100:00100000:3.0:1788687934.364498:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:3.0:1788687934.364515:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:14439:x1875574819767424:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:3.0:1788687934.364577:0:14477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687934.364604:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a110 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462f72 expref: 9 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.364625:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687934.364630:0:14477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687934.364842:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.364857:0:14477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fd4 expref: 5 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.364866:0:14477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.364908:0:14477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fd4 expref: 5 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.364923:0:14477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fd4 expref: 5 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687934.364936:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fb821500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14477:1875574839679616:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788687934.367157:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c8088000 going to sleep for 11 seconds 00000100:00100000:3.0:1788687934.370046:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fb821500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14477:1875574839679616:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788687934.370078:0:14477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687934.371971:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.372932:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819767552 00000100:00100000:3.0:1788687934.372944:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819767552 00010000:00010000:3.0:1788687934.373071:0:16599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fd4 expref: 6 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687934.373116:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:3.0:1788687934.373126:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3202fde6-7dbc-4316-b24e-66eae298a466+6:2348:x1875574819767552:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687934.373140:0:16599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687934.373148:0:16599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fd4 expref: 6 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.373162:0:16599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fd4 expref: 6 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.373186:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a148 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943462fd4 expref: 6 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.373203:0:16599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687934.373209:0:16599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.373219:0:16599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.373260:0:16599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.373294:0:16599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687934.373361:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3202fde6-7dbc-4316-b24e-66eae298a466+5:2348:x1875574819767552:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 236us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687934.373368:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00010000:00010000:0.0:1788687934.373740:0:14477:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.373750:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.373775:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.373785:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.373792:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788687934.374684:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788687934.378552:0:14477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788687934.378574:0:14477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.378585:0:14477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.378593:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.378600:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aac400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687934.378606:0:14477:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.378615:0:14477:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.378712:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687934.378717:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687934.378721:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.378729:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac400/0xc2ddd83e7444a1e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788687934.378752:0:14477:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003db684cc reply state 00000000fc45df2a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687934.378761:0:14477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788687934.378871:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+10:14439:x1875574819767424:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 14358us (15687us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788687934.378880:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00010000:00010000:3.0:1788687934.384042:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.384060:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.384068:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.384074:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687934.384079:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.384087:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.384104:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9af3d2736200) 00010000:00010000:3.0:1788687934.384107:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687934.384112:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.384119:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687934.453747:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687934.454037:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819767680 00000100:00100000:0.0:1788687934.454057:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819767680 00000100:00100000:0.0:1788687934.454126:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:0.0:1788687934.454137:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:14447:x1875574819767680:12345-192.168.204.26@tcp:101:lctl.0 00010000:00010000:0.0:1788687934.454163:0:15887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687934.454187:0:15887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943462ffe expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.454273:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a1f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.454289:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.454320:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687934.454357:0:15887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788687934.454361:0:15887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687934.454401:0:15887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.454428:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a1f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ffe expref: 11 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.454448:0:15887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79edc00/0xc2ddd83e7444a1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943462ffe expref: 10 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.454456:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687934.454459:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687934.454462:0:15887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79edc00, rc 0) 00000100:00100000:0.0:1788687934.454630:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+10:14447:x1875574819767680:12345-192.168.204.26@tcp:101:lctl.0 Request processed in 494us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687934.454638:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:0.0:1788687934.476093:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.476200:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819767808 00000100:00100000:3.0:1788687934.476210:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819767808 00000100:00100000:3.0:1788687934.476288:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:3.0:1788687934.476299:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3202fde6-7dbc-4316-b24e-66eae298a466+5:14449:x1875574819767808:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687934.476319:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687934.476338:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a1fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463005 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.476405:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a205 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.476418:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.476430:0:14476:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687934.476464:0:14476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788687934.476468:0:14476:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788687934.476523:0:14476:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.476548:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a1fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463005 expref: 7 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.476565:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aac200/0xc2ddd83e7444a205 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463005 expref: 6 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.476573:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687934.476589:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788687934.476593:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aac200, rc 0) 00000100:00100000:3.0:1788687934.476658:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3202fde6-7dbc-4316-b24e-66eae298a466+6:14449:x1875574819767808:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 360us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687934.476665:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:2.0:1788687934.479273:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687934.479405:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819767936 00000100:00100000:0.0:1788687934.479414:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819767936 00000100:00100000:0.0:1788687934.479553:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:0.0:1788687934.479563:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3202fde6-7dbc-4316-b24e-66eae298a466+6:14449:x1875574819767936:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687934.479583:0:15887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687934.479601:0:15887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a20c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de3594346300c expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479678:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a213 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479691:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479702:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479717:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a21a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479724:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479731:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479817:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e7444a221 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479825:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e7444a221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479832:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e7444a221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687934.479861:0:15887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788687934.479864:0:15887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687934.479880:0:15887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e7444a221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479903:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479909:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a213 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479915:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a213 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479921:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79eca00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687934.479926:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a213 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479934:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a213 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479945:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:0.0:1788687934.479948:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687934.479952:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479958:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479971:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479977:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a21a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479982:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a21a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.479994:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ecc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687934.479997:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a21a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.480002:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a21a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.480010:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9af3d2736c00) 00010000:00010000:0.0:1788687934.480012:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687934.480014:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a21a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.480019:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a21a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.480064:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed600/0xc2ddd83e7444a20c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346300c expref: 8 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.480079:0:15887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e7444a221 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346300c expref: 7 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.480085:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:0.0:1788687934.480087:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687934.480089:0:15887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ec000, rc 0) 00000100:00100000:0.0:1788687934.480161:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3202fde6-7dbc-4316-b24e-66eae298a466+7:14449:x1875574819767936:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 599us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687934.480168:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:2.0:1788687934.483561:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.483626:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819768192 00000100:00100000:3.0:1788687934.483635:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819768192 00000100:00100000:3.0:1788687934.483692:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788687934.483699:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3202fde6-7dbc-4316-b24e-66eae298a466+7:14449:x1875574819768192:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687934.483718:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687934.483748:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463013 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687934.483841:0:14476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788687934.483957:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a228 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463013 expref: 9 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.483968:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687934.483971:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788687934.483974:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463013 expref: 9 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.483983:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aacc00, rc 0) 00000100:00100000:3.0:1788687934.484028:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3202fde6-7dbc-4316-b24e-66eae298a466+8:14449:x1875574819768192:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 331us (475us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788687934.484033:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788687934.486791:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687934.486939:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819768448 00000100:00100000:1.0:1788687934.486950:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819768448 00000100:00100000:1.0:1788687934.487009:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:1.0:1788687934.487019:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3202fde6-7dbc-4316-b24e-66eae298a466+8:14449:x1875574819768448:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:1.0:1788687934.487254:0:14478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687934.487348:0:14478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec000/0xc2ddd83e7444a221 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346300c expref: 8 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.487465:0:14478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:1.0:1788687934.487475:0:14478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788687934.487523:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.487537:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.487546:0:14478:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788687934.488337:0:14478:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9ed8982 reply state 0000000050d61e36 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687934.488710:0:14478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788687934.488720:0:14478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788687934.488917:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3202fde6-7dbc-4316-b24e-66eae298a466+9:14449:x1875574819768448:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 1897us (2133us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788687934.488926:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00010000:00010000:3.0:1788687934.495208:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.495227:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.495235:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.495251:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687934.495256:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.495264:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.495281:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9af3c7fb4c00) 00010000:00010000:3.0:1788687934.495284:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788687934.495289:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.495294:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a236 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687934.496852:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687934.497046:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819768704 00000100:00100000:2.0:1788687934.497055:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819768704 00000100:00100000:2.0:1788687934.497127:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:2.0:1788687934.497138:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3202fde6-7dbc-4316-b24e-66eae298a466+8:14449:x1875574819768704:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788687934.497400:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3202fde6-7dbc-4316-b24e-66eae298a466+9:14449:x1875574819768704:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 263us (554us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788687934.497409:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:1.0:1788687934.501764:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.501849:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819768960 00000100:00100000:3.0:1788687934.501859:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819768960 00000100:00100000:3.0:1788687934.501915:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:3.0:1788687934.501925:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3202fde6-7dbc-4316-b24e-66eae298a466+9:14449:x1875574819768960:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687934.501950:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687934.501972:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a23d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de3594346301a expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502060:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a244 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502088:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502100:0:14476:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502117:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a24b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502124:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502131:0:14476:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687934.502238:0:14476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788687934.502336:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502343:0:14476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a244 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502350:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a244 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502355:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687934.502359:0:14476:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a244 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502384:0:14476:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a244 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502397:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687934.502400:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687934.502404:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502411:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502424:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502429:0:14476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a24b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502436:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a24b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502441:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aadc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687934.502443:0:14476:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a24b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502452:0:14476:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a24b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502459:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9af3ca87c200) 00010000:00010000:3.0:1788687934.502462:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687934.502465:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a24b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502531:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a24b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502572:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a23d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346301a expref: 11 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502582:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687934.502584:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788687934.502588:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a23d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346301a expref: 11 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.502598:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aacc00, rc 0) 00000100:00100000:3.0:1788687934.502653:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3202fde6-7dbc-4316-b24e-66eae298a466+10:14449:x1875574819768960:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 729us (899us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788687934.502661:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:1.0:1788687934.506062:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687934.506192:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819769088 00000100:00100000:0.0:1788687934.506215:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819769088 00000100:00100000:0.0:1788687934.506328:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:0.0:1788687934.506339:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3202fde6-7dbc-4316-b24e-66eae298a466+10:14449:x1875574819769088:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788687934.506433:0:15887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687934.506594:0:15887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a259 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463021 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.506704:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.506718:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.506730:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687934.506753:0:15887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788687934.506757:0:15887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788687934.506776:0:15887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.506803:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a259 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463021 expref: 12 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.506820:0:15887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463021 expref: 11 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.506828:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9af3d2736c00) 00010000:00010000:0.0:1788687934.506830:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788687934.506833:0:15887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79eca00, rc 0) 00000100:00100000:0.0:1788687934.506893:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3202fde6-7dbc-4316-b24e-66eae298a466+11:14449:x1875574819769088:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 556us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687934.506900:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:0.0:1788687934.511292:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687934.511399:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819769216 00000100:00100000:2.0:1788687934.511410:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819769216 00000100:00100000:2.0:1788687934.511542:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:2.0:1788687934.511555:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3202fde6-7dbc-4316-b24e-66eae298a466+11:14449:x1875574819769216:12345-192.168.204.26@tcp:37:lfs.0 00000100:00100000:2.0:1788687934.517931:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3202fde6-7dbc-4316-b24e-66eae298a466+11:14449:x1875574819769216:12345-192.168.204.26@tcp:37:lfs.0 Request processed in 6366us (6635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687934.517956:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:1.0:1788687934.522908:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687934.522988:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819769472 00000100:00100000:0.0:1788687934.523005:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819769472 00000100:00100000:0.0:1788687934.523081:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:0.0:1788687934.523093:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3eea67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3202fde6-7dbc-4316-b24e-66eae298a466+11:14449:x1875574819769472:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788687934.524201:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3eea67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3202fde6-7dbc-4316-b24e-66eae298a466+12:14449:x1875574819769472:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 261us (458us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788687934.524212:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000040:00080000:1.0:1788687934.535022:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788687934.553150:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687934.553231:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819769600 00000100:00100000:1.0:1788687934.553455:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819769600 00000100:00100000:1.0:1788687934.559380:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:1.0:1788687934.559409:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+10:14455:x1875574819769600:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788687934.559433:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687934.559458:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463028 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559540:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a26e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559555:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a26e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559566:0:14476:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a26e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559583:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a275 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559623:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559630:0:14476:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559721:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444a27c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559731:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444a27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559738:0:14476:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444a27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687934.559765:0:14476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788687934.559768:0:14476:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687934.559806:0:14476:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444a27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559819:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a26e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.559825:0:14476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a26e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560284:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a26e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560292:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687934.560296:0:14476:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a26e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560314:0:14476:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a26e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560328:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:1.0:1788687934.560331:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687934.560336:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a26e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560343:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a26e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560358:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560364:0:14476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a275 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560370:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a275 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560375:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687934.560378:0:14476:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a275 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560383:0:14476:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a275 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560390:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9af3c7fb4f00) 00010000:00010000:1.0:1788687934.560392:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687934.560395:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a275 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560409:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a275 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560445:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463028 expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560459:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc000/0xc2ddd83e7444a27c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463028 expref: 11 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.560466:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9af3d2736c00) 00010000:00010000:1.0:1788687934.560469:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788687934.560471:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc000, rc 0) 00000100:00100000:1.0:1788687934.560909:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+11:14455:x1875574819769600:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1512us (7766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687934.560928:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:1.0:1788687934.567440:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.567590:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819769856 00000100:00100000:3.0:1788687934.567601:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819769856 00000100:00100000:0.0:1788687934.567833:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:0.0:1788687934.567847:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+11:14455:x1875574819769856:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788687934.567868:0:15887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687934.567890:0:15887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a283 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de3594346302f expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.568012:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.568028:0:15887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463021 expref: 11 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.568038:0:15887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.568458:0:15887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463021 expref: 11 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.568562:0:15887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463021 expref: 11 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687934.568576:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3f3c51500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15887:1875574839679744:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788687934.568787:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c89aab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788687934.573361:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3f3c51500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15887:1875574839679744:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788687934.573398:0:15887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687934.578789:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687934.578962:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819769984 00000100:00100000:2.0:1788687934.578973:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819769984 00010000:00010000:2.0:1788687934.579018:0:14461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463021 expref: 12 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687934.579065:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:2.0:1788687934.579076:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3ffe39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3202fde6-7dbc-4316-b24e-66eae298a466+12:2348:x1875574819769984:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788687934.579093:0:14461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788687934.579101:0:14461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463021 expref: 12 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.579115:0:14461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463021 expref: 12 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.579139:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79eca00/0xc2ddd83e7444a260 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463021 expref: 12 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.579226:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9af3d2736c00) 00010000:00010000:2.0:1788687934.579234:0:14461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.579256:0:14461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.579264:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.579417:0:14461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788687934.579525:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3202fde6-7dbc-4316-b24e-66eae298a466+11:2348:x1875574819769984:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 450us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687934.579533:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00010000:00010000:0.0:1788687934.580113:0:15887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580123:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580148:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580170:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580180:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580892:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580903:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580918:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788687934.580930:0:15887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788687934.580960:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580967:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580974:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580980:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ece00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687934.580984:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.580991:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.581001:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9af3d2736c00) 00010000:00010000:0.0:1788687934.581004:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687934.581007:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.581014:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a28a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788687934.581027:0:15887:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f213c2cb reply state 00000000ee3a6e7d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687934.581046:0:15887:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788687934.581081:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a283 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346302f expref: 14 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.581095:0:15887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346302f expref: 13 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.581103:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:0.0:1788687934.581104:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788687934.581107:0:15887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ecc00, rc 0) 00000100:00100000:0.0:1788687934.581180:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3ffe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+14:14455:x1875574819769856:12345-192.168.204.26@tcp:101:bash.0 Request processed in 13337us (13876us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788687934.581188:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00010000:00010000:3.0:1788687934.583780:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.583798:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.583806:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.583812:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687934.583831:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.583839:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.583856:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9af3d2736400) 00010000:00010000:3.0:1788687934.583859:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687934.583864:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.583871:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ec400/0xc2ddd83e7444a291 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687934.596727:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687934.596870:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819770112 00000100:00100000:2.0:1788687934.596881:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819770112 00000100:00100000:2.0:1788687934.596946:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:2.0:1788687934.596957:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fb820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+13:14455:x1875574819770112:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788687934.596985:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788687934.597007:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d200/0xc2ddd83e7444a2a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463036 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.597074:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.597089:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.597099:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788687934.597132:0:14477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788687934.597135:0:14477:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788687934.597154:0:14477:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.597292:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.597319:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d200/0xc2ddd83e7444a2a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463036 expref: 15 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.597357:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463036 expref: 14 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687934.597366:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:2.0:1788687934.597369:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788687934.597372:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f4b4ce00, rc 0) 00000100:00100000:2.0:1788687934.597585:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fb820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+14:14455:x1875574819770112:12345-192.168.204.26@tcp:101:bash.0 Request processed in 629us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687934.597593:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:1.0:1788687934.607961:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687934.608077:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819770368 00000100:00100000:2.0:1788687934.608088:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819770368 00000100:00100000:2.0:1788687934.608147:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:2.0:1788687934.608156:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+14:14455:x1875574819770368:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:2.0:1788687934.608713:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+15:14455:x1875574819770368:12345-192.168.204.26@tcp:35:bash.0 Request processed in 556us (762us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788687934.608722:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:1.0:1788687934.695657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.695908:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819770624 00000100:00100000:3.0:1788687934.695921:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819770624 00000100:00100000:3.0:1788687934.696063:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:3.0:1788687934.696077:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af2c2a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+15:14465:x1875574819770624:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687934.696113:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687934.696144:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a2b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de3594346303d expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687934.696313:0:14478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788687934.696525:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a2b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346303d expref: 17 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.696543:0:14478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af3d2736d00) 00010000:00010000:3.0:1788687934.696559:0:14478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788687934.696578:0:14478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a2b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346303d expref: 17 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.696595:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aacc00, rc 0) 00000100:00100000:3.0:1788687934.696676:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af2c2a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+16:14465:x1875574819770624:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 592us (1026us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788687934.696685:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:2.0:1788687934.699748:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687934.700063:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819770880 00000100:00100000:0.0:1788687934.700081:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819770880 00000100:00100000:0.0:1788687934.700158:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:0.0:1788687934.700171:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+16:14465:x1875574819770880:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788687934.700696:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+17:14465:x1875574819770880:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 525us (959us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788687934.700708:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:1.0:1788687934.745205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687934.745468:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819771136 00000100:00100000:3.0:1788687934.745519:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819771136 00000100:00100000:3.0:1788687934.745599:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:3.0:1788687934.745611:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+17:14468:x1875574819771136:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788687934.745870:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687934.745893:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a2c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463044 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.745991:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a2c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.746004:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.746015:0:14476:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788687934.746026:0:14476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788687934.746230:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a2c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463044 expref: 20 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.746322:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a2c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463044 expref: 19 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687934.746451:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:3.0:1788687934.746455:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687934.746459:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aadc00, rc 0) 00000100:00100000:3.0:1788687934.746573:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+19:14468:x1875574819771136:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 965us (1398us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788687934.746581:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:1.0:1788687934.751460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687934.751805:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819771264 00000100:00100000:0.0:1788687934.751819:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819771264 00000100:00100000:0.0:1788687934.751952:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788687934.751966:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+19:2346:x1875574819771264:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687934.751988:0:14463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687934.752404:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aadc00/0xc2ddd83e7444a2c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463044 expref: 19 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687934.752429:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:0.0:1788687934.752436:0:14463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687934.752564:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+18:2346:x1875574819771264:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 600us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687934.752573:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:2.0:1788687934.755578:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687934.756111:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819771392 00000100:00100000:1.0:1788687934.756126:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819771392 00000100:00100000:1.0:1788687934.756461:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:1.0:1788687934.756475:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+18:14468:x1875574819771392:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:1.0:1788687934.756861:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.756900:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.756915:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.756952:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.756960:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.756967:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.756974:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd400 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687934.756980:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.756989:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.757003:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:1.0:1788687934.757007:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788687934.757012:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687934.757019:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687934.757899:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+18:14468:x1875574819771392:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 1419us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687934.757925:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:2.0:1788687934.765367:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687934.765463:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819771648 00000100:00100000:0.0:1788687934.765477:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819771648 00000100:00100000:0.0:1788687934.765599:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788687934.765613:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+18:14468:x1875574819771648:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788687934.765980:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+19:14468:x1875574819771648:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 368us (639us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788687934.765989:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788687935.024608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.025138:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819771904 00000100:00100000:1.0:1788687935.025155:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819771904 00000100:00100000:1.0:1788687935.025253:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:1.0:1788687935.025267:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+19:14499:x1875574819771904:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:1.0:1788687935.025301:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687935.025330:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de3594346304b expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.025474:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a2e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.025521:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.025535:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687935.025552:0:14477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788687935.025770:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346304b expref: 22 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.025795:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346304b expref: 21 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.025806:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:1.0:1788687935.025809:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788687935.025813:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc600, rc 0) 00000100:00100000:1.0:1788687935.025919:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+21:14499:x1875574819771904:12345-192.168.204.26@tcp:101:cat.0 Request processed in 656us (1330us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788687935.025927:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:3.0:1788687935.033857:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687935.034004:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.034522:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819772288 00000100:00100000:0.0:1788687935.034536:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819772288 00000100:00100000:0.0:1788687935.034604:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:0.0:1788687935.034614:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+21:14499:x1875574819772288:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:0.0:1788687935.034959:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+22:14499:x1875574819772288:12345-192.168.204.26@tcp:35:cat.0 Request processed in 345us (955us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788687935.034967:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:1.0:1788687935.036029:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819772032 00000100:00100000:1.0:1788687935.036124:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819772032 00000100:00100000:1.0:1788687935.036201:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:1.0:1788687935.036212:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+22:2348:x1875574819772032:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687935.036226:0:14462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687935.036264:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a2e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346304b expref: 22 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.036285:0:14462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:1.0:1788687935.036290:0:14462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788687935.036350:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+21:2348:x1875574819772032:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 140us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.036358:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:3.0:1788687935.109913:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.110542:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819772544 00000100:00100000:1.0:1788687935.110601:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819772544 00000100:00100000:1.0:1788687935.110821:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:1.0:1788687935.110832:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+21:14505:x1875574819772544:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1788687935.110857:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687935.110877:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a2f3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463052 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.110973:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.111006:0:14478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346302f expref: 22 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.111014:0:14478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463036 expref: 22 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.111023:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.111136:0:14478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463036 expref: 22 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.111151:0:14478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463036 expref: 22 pid: 14477 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687935.111163:0:14478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14478:1875574839679872:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687935.111336:0:14478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346302f expref: 22 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.111346:0:14478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346302f expref: 22 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687935.111355:0:14478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14478:1875574839680000:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687935.111380:0:14478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c681ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788687935.116672:0:14478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14478:1875574839679872:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788687935.116688:0:14478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14478:1875574839680000:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687935.116744:0:14478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687935.117936:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687935.117981:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.118202:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819772672 00000100:00100000:0.0:1788687935.118212:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819772672 00010000:00010000:0.0:1788687935.118263:0:14463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463036 expref: 23 pid: 14477 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687935.118318:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819772800 00000100:00100000:0.0:1788687935.118322:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819772800 00010000:00010000:0.0:1788687935.118338:0:14463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346302f expref: 24 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687935.118371:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788687935.118380:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fcd75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:2348:x1875574819772672:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687935.118393:0:14463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687935.118401:0:14463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463036 expref: 24 pid: 14477 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118413:0:14463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463036 expref: 24 pid: 14477 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118434:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a2ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de35943463036 expref: 24 pid: 14477 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118452:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:0.0:1788687935.118457:0:14463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118466:0:14463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118473:0:14463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687935.118562:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fcd75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+23:2348:x1875574819772672:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 183us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687935.118579:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788687935.118637:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:0.0:1788687935.118644:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+22:2348:x1875574819772800:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788687935.118651:0:14463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687935.118657:0:14463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346302f expref: 22 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118667:0:14463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346302f expref: 22 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118679:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a298 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346302f expref: 22 pid: 15887 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118689:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:0.0:1788687935.118693:0:14463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118700:0:14463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118707:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.118728:0:14463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687935.118761:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+21:2348:x1875574819772800:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 103us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687935.118768:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00010000:00010000:1.0:1788687935.118878:0:14478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.118887:0:14478:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687935.118905:0:14478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788687935.119080:0:14478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a2f3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463052 expref: 22 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.119096:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd400/0xc2ddd83e7444a2fa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463052 expref: 21 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.119104:0:14478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:1.0:1788687935.119107:0:14478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788687935.119109:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cd400, rc 0) 00000100:00100000:1.0:1788687935.119133:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+21:14505:x1875574819772544:12345-192.168.204.26@tcp:101:dd.0 Request processed in 8304us (9230us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788687935.119141:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:2.0:1788687935.122883:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.123026:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819773056 00000100:00100000:1.0:1788687935.123036:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819773056 00000100:00100000:1.0:1788687935.123216:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:1.0:1788687935.123241:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+21:14505:x1875574819773056:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:1.0:1788687935.123900:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.123937:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.123947:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788687935.124000:0:14477:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788687935.124037:0:14477:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000310fc14a reply state 000000002c78f318 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687935.124045:0:14477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788687935.124268:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14505:x1875574819773056:12345-192.168.204.26@tcp:36:dd.0 Request processed in 1041us (1393us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788687935.124276:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000020:00080000:1.0:1788687935.124281:0:14477:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788687935.126133:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.126148:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.126156:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.126161:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687935.126166:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.126173:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.126190:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:3.0:1788687935.126204:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687935.126210:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.126216:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a308 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687935.127637:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.129156:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819773184 00000100:00100000:1.0:1788687935.129169:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819773184 00000100:00100000:1.0:1788687935.129310:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:1.0:1788687935.129332:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+23:14505:x1875574819773184:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1788687935.129368:0:15887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687935.129398:0:15887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a30f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463059 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.129467:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a30f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463059 expref: 24 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.129497:0:15887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a30f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463059 expref: 24 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.129537:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:1.0:1788687935.129541:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687935.129545:0:15887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc600, rc 0) 00000100:00100000:1.0:1788687935.129614:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14505:x1875574819773184:12345-192.168.204.26@tcp:101:dd.0 Request processed in 296us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.129621:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:2.0:1788687935.145582:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.145720:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819773440 00000100:00100000:0.0:1788687935.145731:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819773440 00000100:00100000:0.0:1788687935.145908:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:0.0:1788687935.145919:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14505:x1875574819773440:12345-192.168.204.26@tcp:103:dd.0 00010000:00010000:0.0:1788687935.145936:0:14463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687935.145963:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a30f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463059 expref: 24 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.146175:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:0.0:1788687935.146182:0:14463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788687935.146327:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+23:14505:x1875574819773440:12345-192.168.204.26@tcp:103:dd.0 Request processed in 408us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687935.146335:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:3.0:1788687935.148447:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.148667:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819773568 00000100:00100000:1.0:1788687935.148677:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819773568 00000100:00100000:1.0:1788687935.148729:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:1.0:1788687935.148738:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+23:14505:x1875574819773568:12345-192.168.204.26@tcp:58:dd.0 00010000:00010000:1.0:1788687935.148831:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.148848:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.148858:0:14476:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788687935.149970:0:14476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788687935.150134:0:14476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788687935.150208:0:14476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788687935.150327:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+23:14505:x1875574819773568:12345-192.168.204.26@tcp:58:dd.0 Request processed in 1587us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.150338:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:2.0:1788687935.152441:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.152580:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819773696 00000100:00100000:1.0:1788687935.152590:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819773696 00000100:00100000:1.0:1788687935.152720:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:1.0:1788687935.152732:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+23:14505:x1875574819773696:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1788687935.152752:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687935.152774:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a31d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463060 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.152826:0:14478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.152837:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a31d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463060 expref: 24 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.152855:0:14478:0:(ldlm_request.c:384:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.152868:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a31d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463060 expref: 24 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.152882:0:14478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:1.0:1788687935.152885:0:14478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788687935.152889:0:14478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a31d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463060 expref: 24 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.152897:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f38cc400, rc 0) 00000100:00100000:1.0:1788687935.152956:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14505:x1875574819773696:12345-192.168.204.26@tcp:101:dd.0 Request processed in 227us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.152963:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00010000:00010000:3.0:1788687935.301798:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788687935.557902:0:14508:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788687935.557931:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687935.557988:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788687935.557996:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788687935.558148:0:14508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1875574839680128:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788687935.558580:0:14508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c681c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788687935.561050:0:14508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1875574839680128:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788687935.567633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.567853:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819773824 00000100:00100000:0.0:1788687935.567870:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819773824 00000100:00100000:0.0:1788687935.567941:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788687935.567952:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14506:x1875574819773824:12345-192.168.204.26@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788687935.568071:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14506:x1875574819773824:12345-192.168.204.26@tcp:900:lhsmtool_posix.0 Request processed in 119us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687935.568080:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:2.0:1788687935.569753:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.569872:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819773952 00000100:00100000:1.0:1788687935.569883:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819773952 00000100:00100000:1.0:1788687935.569955:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:1.0:1788687935.569968:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14506:x1875574819773952:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788687935.570009:0:14477:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788687935.570148:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14506:x1875574819773952:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 182us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.570156:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:2.0:1788687935.573153:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.573292:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819774080 00000100:00100000:1.0:1788687935.573304:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819774080 00000100:00100000:1.0:1788687935.573414:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:1.0:1788687935.573426:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14506:x1875574819774080:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788687935.573575:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a324 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573598:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a324 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573614:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a324 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573636:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a32b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573661:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a32b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573669:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a32b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573701:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573710:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573728:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687935.573863:0:15887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788687935.573869:0:15887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687935.573890:0:15887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573903:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a324 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573911:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a324 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573919:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a324 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.573925:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687935.573930:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a324 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574010:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a324 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574028:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3c7f7ca00) 00010000:00010000:1.0:1788687935.574031:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687935.574037:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a324 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574044:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd600/0xc2ddd83e7444a324 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574060:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a32b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574067:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a32b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574073:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a32b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574078:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cc600 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687935.574081:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a32b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574086:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a32b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574090:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9af3c7fb4f00) 00010000:00010000:1.0:1788687935.574092:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687935.574093:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a32b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574106:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc600/0xc2ddd83e7444a32b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574123:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574126:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574131:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574134:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687935.574135:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574138:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574142:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:1.0:1788687935.574144:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788687935.574145:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.574148:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd200/0xc2ddd83e7444a332 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687935.574245:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14506:x1875574819774080:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 817us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.574253:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:2.0:1788687935.576455:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.576546:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819774336 00000100:00100000:1.0:1788687935.576560:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819774336 00000100:00100000:1.0:1788687935.576624:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:1.0:1788687935.576637:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+24:14506:x1875574819774336:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687935.576674:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687935.576739:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1e00/0xc2ddd83e7444a339 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463067 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577066:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a340 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577085:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577098:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687935.577111:0:14477:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788687935.577265:0:14477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577276:0:14477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a340 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577284:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a340 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577291:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f49d0c00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:1.0:1788687935.577297:0:14477:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a340 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577306:0:14477:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a340 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577350:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:1.0:1788687935.577353:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788687935.577359:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a340 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577367:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a340 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577426:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1e00/0xc2ddd83e7444a339 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463067 expref: 26 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577438:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9af3c7f7ca00) 00010000:00010000:1.0:1788687935.577441:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788687935.577445:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1e00/0xc2ddd83e7444a339 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463067 expref: 26 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.577455:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f49d1e00, rc 0) 00000100:00100000:1.0:1788687935.577582:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+25:14506:x1875574819774336:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 947us (1140us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788687935.577592:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:2.0:1788687935.582214:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.582415:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819774464 00000100:00100000:1.0:1788687935.582431:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819774464 00000100:00100000:1.0:1788687935.582540:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:1.0:1788687935.583075:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+25:14506:x1875574819774464:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788687935.583125:0:14478:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788687935.583428:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+25:14506:x1875574819774464:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 877us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.583447:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:2.0:1788687935.587744:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687935.588800:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819774720 00000100:00100000:3.0:1788687935.588817:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819774720 00000100:00100000:3.0:1788687935.588943:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:3.0:1788687935.588957:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+25:14506:x1875574819774720:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687935.588987:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687935.589016:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a34e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de3594346306e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788687935.590822:0:14476:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788687935.590835:0:14476:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788687935.590903:0:14476:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788687935.591285:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a355 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.591308:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.591323:0:14476:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.591863:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a34e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346306e expref: 28 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.591903:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a355 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346306e expref: 27 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.591913:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3ca87c200) 00010000:00010000:3.0:1788687935.591917:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788687935.591921:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad600, rc 0) 00000100:00100000:3.0:1788687935.592086:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+27:14506:x1875574819774720:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 3131us (4356us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788687935.592097:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:2.0:1788687935.594974:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.595084:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819774976 00000100:00100000:0.0:1788687935.595098:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819774976 00000100:00100000:0.0:1788687935.595177:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:0.0:1788687935.595190:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+27:14506:x1875574819774976:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788687935.595288:0:15887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788687935.595328:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad600/0xc2ddd83e7444a355 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346306e expref: 27 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595373:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3ca87c200) 00010000:00010000:0.0:1788687935.595388:0:15887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788687935.595421:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a363 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595439:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a363 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595450:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a363 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595466:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a36a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd044db5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595473:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a36a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd044db5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595527:0:15887:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a36a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd044db5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595731:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a363 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595740:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a363 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595746:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a363 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595752:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ecc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687935.595757:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a363 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595772:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a363 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595783:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9af3d2736c00) 00010000:00010000:0.0:1788687935.595786:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687935.595790:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a363 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.595797:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ecc00/0xc2ddd83e7444a363 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.596065:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a36a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd044db5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.596072:0:15887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a36a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd044db5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.596078:0:15887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a36a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd044db5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.596083:0:15887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ed800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687935.596086:0:15887:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a36a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd044db5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.596093:0:15887:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a36a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd044db5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.596103:0:15887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd044db5c (ffff9af3d2736200) 00010000:00010000:0.0:1788687935.596106:0:15887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687935.596109:0:15887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a36a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd044db5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.596127:0:15887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ed800/0xc2ddd83e7444a36a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd044db5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687935.596296:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+26:14506:x1875574819774976:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 1107us (1337us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788687935.596305:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:2.0:1788687935.598888:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.598979:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819775104 00000100:00100000:1.0:1788687935.598991:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819775104 00000100:00100000:1.0:1788687935.599085:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:1.0:1788687935.599097:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+26:14506:x1875574819775104:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687935.599124:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687935.599154:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1e00/0xc2ddd83e7444a371 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463075 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.599197:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a378 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.599214:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a378 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.599238:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a378 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.599377:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1e00/0xc2ddd83e7444a371 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463075 expref: 28 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.599397:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d0c00/0xc2ddd83e7444a378 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463075 expref: 27 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.599407:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3c7fb4f00) 00010000:00010000:1.0:1788687935.599410:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788687935.599414:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f49d0c00, rc 0) 00000100:00100000:1.0:1788687935.599507:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+27:14506:x1875574819775104:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 387us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.599523:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:2.0:1788687935.602556:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687935.602647:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819775360 00000100:00100000:3.0:1788687935.602775:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819775360 00000100:00100000:3.0:1788687935.602885:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:3.0:1788687935.602899:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+27:14506:x1875574819775360:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788687935.603013:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.603036:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.603050:0:14478:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788687935.603610:0:14478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788687935.603623:0:14478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 481294142004ns, next at 482294138862ns, rc = 0 00000004:00010000:3.0:1788687935.603912:0:14478:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d2f53e6 reply state 000000001b9f2a1f transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687935.603944:0:14478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788687935.604132:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+29:14506:x1875574819775360:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 1233us (1667us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788687935.604140:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00010000:00010000:3.0:1788687935.606838:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.606857:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.606865:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.606871:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aacc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687935.606877:0:3297:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.606886:0:3297:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.606907:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3c7fb4f00) 00010000:00010000:3.0:1788687935.606910:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788687935.606914:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.606921:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a37f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687935.607836:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687935.608115:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819775488 00000100:00100000:3.0:1788687935.608127:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819775488 00000100:00100000:3.0:1788687935.608215:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:3.0:1788687935.608235:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+28:14506:x1875574819775488:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788687935.608266:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788687935.608288:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a386 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de3594346307c expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.608361:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a386 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346307c expref: 29 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.608376:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a386 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346307c expref: 29 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.608396:0:14476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3c7fb4f00) 00010000:00010000:3.0:1788687935.608399:0:14476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788687935.608403:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3e0aad200, rc 0) 00000100:00100000:3.0:1788687935.608636:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+29:14506:x1875574819775488:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 402us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687935.608644:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:2.0:1788687935.611052:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.611154:0:15162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819775616 00000100:00100000:1.0:1788687935.611167:0:15162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819775616 00000100:00080000:3.0:1788687935.611314:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788687935.611356:0:15162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:1.0:1788687935.611370:0:15162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:2346:x1875574819775616:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788687935.612116:0:15162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:2346:x1875574819775616:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 747us (1073us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788687935.612126:0:15162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:2.0:1788687935.614644:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.614808:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819775872 00000100:00100000:0.0:1788687935.614821:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819775872 00000100:00100000:2.0:1788687935.614919:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:2.0:1788687935.614933:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+29:14506:x1875574819775872:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788687935.615271:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+30:14506:x1875574819775872:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 341us (643us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788687935.615282:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:2.0:1788687935.617014:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687935.617280:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819776128 00000100:00100000:3.0:1788687935.617293:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819776128 00000100:00100000:3.0:1788687935.617366:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:3.0:1788687935.617379:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+30:14506:x1875574819776128:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788687935.617649:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+30:14506:x1875574819776128:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 271us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687935.617668:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:3.0:1788687935.620010:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.620145:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819776256 00000100:00100000:1.0:1788687935.620157:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819776256 00000100:00100000:1.0:1788687935.620265:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:1.0:1788687935.620277:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fc1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+30:14506:x1875574819776256:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788687935.620306:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788687935.620334:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1e00/0xc2ddd83e7444a38d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de35943463083 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.620426:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1000/0xc2ddd83e7444a394 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.620443:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1000/0xc2ddd83e7444a394 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.620457:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1000/0xc2ddd83e7444a394 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788687935.620529:0:14477:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788687935.620662:0:14477:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1000/0xc2ddd83e7444a394 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.620706:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1e00/0xc2ddd83e7444a38d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463083 expref: 32 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.620801:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1000/0xc2ddd83e7444a394 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463083 expref: 31 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.620812:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3c7fb4f00) 00010000:00010000:1.0:1788687935.620815:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788687935.620819:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f49d1000, rc 0) 00000100:00100000:1.0:1788687935.620901:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fc1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+31:14506:x1875574819776256:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 627us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.620909:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:2.0:1788687935.623339:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.623569:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819776384 00000100:00100000:0.0:1788687935.623582:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819776384 00000100:00100000:0.0:1788687935.623706:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788687935.623719:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:2349:x1875574819776384:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788687935.623744:0:15953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788687935.623770:0:15953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444a39b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa2de3594346308a expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788687935.623808:0:15953:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d363f, blocks: 0x1 00010000:00010000:0.0:1788687935.623833:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1788687935.623838:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687935.623849:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444a39b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346308a expref: 7 pid: 15953 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.623871:0:15953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444a39b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346308a expref: 7 pid: 15953 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.623889:0:15953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af3f79ed800, rc 0) 00000100:00100000:0.0:1788687935.623980:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+7:2349:x1875574819776384:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 264us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687935.623988:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:2.0:1788687935.626332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687935.626420:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819776640 00000100:00100000:3.0:1788687935.626433:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819776640 00000100:00100000:3.0:1788687935.626513:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:3.0:1788687935.626526:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+31:14506:x1875574819776640:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788687935.626887:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+31:14506:x1875574819776640:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 363us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687935.626897:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:3.0:1788687935.630052:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.631183:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819776768 00000100:00100000:1.0:1788687935.631201:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819776768 00000100:00100000:1.0:1788687935.631301:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:1.0:1788687935.631314:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+31:14506:x1875574819776768:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788687935.701507:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:3.0:1788687935.701684:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1788687935.701841:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:0.0:1788687935.702203:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1788687935.702354:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788687935.702947:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788687935.702973:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839680256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788687935.703121:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687935.703270:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839680256 00000100:00100000:1.0:1788687935.703282:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839680256 00000100:00100000:1.0:1788687935.703375:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788687935.703388:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875574839680256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788687935.703752:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+14:14506:x1875574819776768:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 72435us (73711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788687935.703765:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00080000:3.0:1788687935.704522:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1788687935.704607:0:15160:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788687935.704611:0:15160:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788687935.705127:0:15160:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788687935.705131:0:15160:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788687935 -> 1788687935 00002000:00010000:1.0:1788687935.705135:0:15160:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788687935.705289:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875574839680256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1901us (2234us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788687935.705318:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1788687935.706443:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9af3c830c700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788687935.706458:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875574839680256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788687935.707879:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.707985:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819776896 00000100:00100000:0.0:1788687935.708005:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819776896 00000100:00100000:0.0:1788687935.708084:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788687935.708095:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+7:2347:x1875574819776896:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788687935.708263:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+7:2347:x1875574819776896:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 169us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687935.708272:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788687935.710879:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687935.711032:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819777152 00000100:00100000:3.0:1788687935.711046:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819777152 00000100:00100000:3.0:1788687935.711124:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:3.0:1788687935.711138:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+14:14506:x1875574819777152:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788687935.711230:0:14478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687935.711268:0:14478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f49d1000/0xc2ddd83e7444a394 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463083 expref: 14 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.711293:0:14478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3c7fb4f00) 00010000:00010000:3.0:1788687935.711317:0:14478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687935.711358:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.711374:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.711385:0:14478:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788687935.712284:0:14478:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3b2a2ae reply state 0000000021634562 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687935.712302:0:14478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788687935.715477:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+15:14506:x1875574819777152:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 4324us (4595us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788687935.715508:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00010000:00010000:0.0:1788687935.720267:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.720293:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.720302:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.720310:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aacc00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:0.0:1788687935.720317:0:3296:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.720327:0:3296:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.720351:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3c7fb4f00) 00010000:00010000:0.0:1788687935.720371:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788687935.720378:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.720386:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aacc00/0xc2ddd83e7444a3a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687935.720896:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687935.724630:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819777280 00000100:00100000:2.0:1788687935.724653:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819777280 00000100:00100000:2.0:1788687935.724902:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1788687935.724914:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+7:2349:x1875574819777280:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788687935.725210:0:15160:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788687935.725225:0:15160:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788687934 00002000:00010000:2.0:1788687935.725229:0:15160:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788687934 00002000:00010000:2.0:1788687935.725231:0:15160:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788687935 -> 1788687934 00002000:00010000:2.0:1788687935.725234:0:15160:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788687935.725335:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+8:2349:x1875574819777280:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 423us (4446us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788687935.725344:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:3.0:1788687935.728130:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.728212:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819777408 00000100:00100000:1.0:1788687935.728236:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819777408 00000100:00100000:1.0:1788687935.728306:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:1.0:1788687935.728318:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+8:2348:x1875574819777408:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788687935.728388:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c55d68d2/0xc2ddd83e7444a3a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.728412:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687935.728418:0:15953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687935.728425:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c55d68d2/0xc2ddd83e7444a3a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.728444:0:15953:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c55d68d2/0xc2ddd83e7444a3a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.728518:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c55d68d2/0xc2ddd83e7444a3a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.728529:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c55d68d2/0xc2ddd83e7444a3a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.728539:0:15953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c55d68d2/0xc2ddd83e7444a3a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.728547:0:15953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f49d1e00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687935.728568:0:15953:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c55d68d2/0xc2ddd83e7444a3a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.728580:0:15953:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c55d68d2/0xc2ddd83e7444a3a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.728601:0:15953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c55d68d2/0xc2ddd83e7444a3a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.728609:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c55d68d2/0xc2ddd83e7444a3a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687935.729876:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+8:2348:x1875574819777408:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 1547us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.729889:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:3.0:1788687935.734001:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687935.734398:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819777664 00000100:00100000:2.0:1788687935.734413:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819777664 00000100:00100000:2.0:1788687935.734533:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:2.0:1788687935.734546:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c697f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+14:14506:x1875574819777664:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788687935.734657:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a3b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.734680:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a3b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.734692:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a3b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.736364:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.736398:0:14477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a386 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346307c expref: 15 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.736409:0:14477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.737475:0:14477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a386 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346307c expref: 15 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.737577:0:14477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a386 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346307c expref: 15 pid: 14476 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687935.737599:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14477:1875574839680384:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687935.738059:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6eac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788687935.740903:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14477:1875574839680384:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788687935.741019:0:14477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687935.747566:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687935.748640:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819777792 00000100:00100000:3.0:1788687935.748657:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819777792 00010000:00010000:3.0:1788687935.748720:0:14462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a386 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346307c expref: 16 pid: 14476 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687935.748839:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:3.0:1788687935.748852:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+16:2349:x1875574819777792:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788687935.748873:0:14462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788687935.748882:0:14462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a386 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346307c expref: 16 pid: 14476 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.748919:0:14462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a386 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346307c expref: 16 pid: 14476 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.748950:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a386 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346307c expref: 16 pid: 14476 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.748972:0:14462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3c7fb4f00) 00010000:00010000:3.0:1788687935.748979:0:14462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.748991:0:14462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.749000:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.749042:0:14462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788687935.749132:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+15:2349:x1875574819777792:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 282us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687935.749141:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00010000:00010000:1.0:1788687935.749550:0:14477:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.749561:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788687935.749835:0:14477:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788687935.750329:0:14477:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788687935.750390:0:14477:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788687935.750609:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14477:1875574839680512:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788687935.750830:0:14477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687935.750931:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f39d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788687935.751067:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839680512 00000100:00100000:0.0:1788687935.751077:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839680512 00000100:00100000:0.0:1788687935.751175:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788687935.751187:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14477:x1875574839680512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788687935.751310:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14477:x1875574839680512:12345-0@lo:1000:mdt00_001.0 Request processed in 126us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687935.751318:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788687935.751391:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14477:1875574839680512:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788687935.752307:0:14477:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788687935.752410:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14477:1875574839680640:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788687935.752471:0:14477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687935.752524:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3c33e1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788687935.752681:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839680640 00000100:00100000:3.0:1788687935.752690:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839680640 00000100:00100000:3.0:1788687935.752730:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687935.752740:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14477:x1875574839680640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788687935.752981:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14477:x1875574839680640:12345-0@lo:1000:mdt00_001.0 Request processed in 241us (509us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788687935.752989:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788687935.753060:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14477:1875574839680640:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788687935.753121:0:14477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753134:0:14477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753143:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753152:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4d800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687935.753168:0:14477:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753178:0:14477:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753200:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3c7fb4f00) 00010000:00010000:3.0:1788687935.753204:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788687935.753209:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753228:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4d800/0xc2ddd83e7444a3b7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753274:0:14477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753843:0:14477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753851:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753865:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f38cd800 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687935.753869:0:14477:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753876:0:14477:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.753890:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:3.0:1788687935.753893:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788687935.753902:0:14477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a31d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463060 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.754128:0:14477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a31d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463060 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.754143:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a31d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463060 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.754252:0:14477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cc400/0xc2ddd83e7444a31d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de35943463060 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687935.754268:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14477:1875574839680768:192.168.204.26@tcp:105: 00000100:00100000:3.0:1788687935.754389:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3f15d5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788687935.758989:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.759142:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819777920 00000100:00100000:0.0:1788687935.759155:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819777920 00000100:00100000:3.0:1788687935.759177:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14477:1875574839680768:192.168.204.26@tcp:105: 00010000:00010000:3.0:1788687935.759230:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759267:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f38cd800/0xc2ddd83e7444a316 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759312:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a3be lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759332:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a3be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759345:0:14477:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a3be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687935.759345:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00010000:00010000:3.0:1788687935.759362:0:14477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a3be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687935.759362:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f149e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+19:14505:x1875574819777920:12345-192.168.204.26@tcp:49:dd.0 00010000:00010000:3.0:1788687935.759375:0:14477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a3be lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759382:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a3be lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759390:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad200 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687935.759395:0:14477:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a3be lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759405:0:14477:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a3be lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759419:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:3.0:1788687935.759423:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788687935.759427:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a3be lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759439:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3e0aad200/0xc2ddd83e7444a3be lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759452:0:14477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a3b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759460:0:14477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a3b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759466:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a3b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759472:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4ce00 already unused, calling callback (ffffffffc20324f0) 00010000:00010000:3.0:1788687935.759475:0:14477:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a3b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759522:0:14477:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a3b0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759534:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9af3d2736900) 00010000:00010000:3.0:1788687935.759536:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788687935.759540:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a3b0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687935.759546:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f4b4ce00/0xc2ddd83e7444a3b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687935.759578:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f149e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+19:14505:x1875574819777920:12345-192.168.204.26@tcp:49:dd.0 Request processed in 219us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687935.759588:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:3.0:1788687935.760195:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c697f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+18:14506:x1875574819777664:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 25649us (26206us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788687935.760206:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00000020:00080000:3.0:1788687935.760236:0:14477:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788687935.761294:0:14508:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788687935.761303:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788687935.761340:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788687935.761346:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788687935.765948:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.767006:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819778176 00000100:00100000:0.0:1788687935.767024:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819778176 00000100:00100000:0.0:1788687935.767114:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788687935.767127:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+18:14506:x1875574819778176:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788687935.772247:0:14480:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788687935.772610:0:14480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788687935.772737:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.772761:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.772774:0:14480:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.772785:0:14480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.772791:0:14480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.772798:0:14480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.772825:0:14480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788687935.772995:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+20:14506:x1875574819778176:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 5864us (7054us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788687935.773016:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000020:00080000:0.0:1788687935.773023:0:14480:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788687935.773602:0:14464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788687935.773616:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.773626:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ece00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:1.0:1788687935.773632:0:14464:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.773642:0:14464:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.773660:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9af3c7fb4f00) 00010000:00010000:1.0:1788687935.773663:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788687935.773669:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.773676:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af3f79ece00/0xc2ddd83e7444a3c5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.773710:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687935.773775:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788687935.773776:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788687935.930825:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687935.931121:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819778304 00000100:00100000:2.0:1788687935.931135:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819778304 00000100:00100000:2.0:1788687935.931250:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:2.0:1788687935.931263:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+8:2346:x1875574819778304:12345-192.168.204.26@tcp:4:dd.0 00010000:00010000:2.0:1788687935.931311:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.931339:0:15165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444a39b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xfa2de3594346308a expref: 8 pid: 15953 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.931348:0:15165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687935.931353:0:15165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687935.931359:0:15165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.931429:0:15165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444a39b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346308a expref: 8 pid: 15953 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.931445:0:15165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444a39b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346308a expref: 8 pid: 15953 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687935.931464:0:15165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15165:1875574839680896:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788687935.931637:0:15165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af3e6eac000 going to sleep for 11 seconds 00000100:00100000:2.0:1788687935.933869:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687935.933907:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.937009:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788687935.937027:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788687935.937946:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819778432 00000100:00100000:1.0:1788687935.937958:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819778432 00000100:00100000:1.0:1788687935.938018:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788687935.938025:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819778560 00000100:00100000:1.0:1788687935.938028:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819778560 00000100:00100000:0.0:1788687935.938863:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:0.0:1788687935.938877:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+10:2347:x1875574819778432:12345-192.168.204.26@tcp:4:dd.0 00010000:00010000:0.0:1788687935.938917:0:16712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.938950:0:16712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687935.938955:0:16712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687935.938961:0:16712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687935.938972:0:16712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687935.941641:0:15165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15165:1875574839680896:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788687935.941683:0:15165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687935.941990:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.942149:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819778688 00000100:00100000:1.0:1788687935.942158:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819778688 00010000:00010000:1.0:1788687935.942198:0:16599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444a39b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346308a expref: 11 pid: 15953 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687935.942273:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:1.0:1788687935.942282:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+11:2348:x1875574819778688:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788687935.942296:0:16599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788687935.942320:0:16599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444a39b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346308a expref: 11 pid: 15953 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.942333:0:16599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444a39b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346308a expref: 11 pid: 15953 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.942355:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8b2f39f/0xc2ddd83e7444a39b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xfa2de3594346308a expref: 11 pid: 15953 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.942377:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687935.942394:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687935.942401:0:16599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.942411:0:16599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.942420:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687935.942423:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788687935.942426:0:16599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.942434:0:16599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788687935.942477:0:16599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788687935.942543:0:15165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687935.942554:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+10:2348:x1875574819778688:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 269us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.942585:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00010000:00010000:3.0:1788687935.942588:0:15165:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.942740:0:16712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687935.942752:0:16712:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687935.980550:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788687935.980598:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.980733:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819778816 00000100:00100000:1.0:1788687935.980744:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819778816 00000100:00100000:1.0:1788687935.980800:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:1.0:1788687935.980810:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:2347:x1875574819778816:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687935.980887:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e481c7-6b5b-4f65-8f9b-12aa1c55d216+13:2347:x1875574819778816:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 78us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.980895:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:1.0:1788687935.981139:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819779072 00000100:00100000:1.0:1788687935.981153:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819779072 00000100:00100000:1.0:1788687935.981203:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:1.0:1788687935.981221:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3f3c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3202fde6-7dbc-4316-b24e-66eae298a466+6:2347:x1875574819779072:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687935.981264:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3202fde6-7dbc-4316-b24e-66eae298a466+6:2347:x1875574819779072:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 54us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.981270:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:1.0:1788687935.981302:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.981335:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.981357:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687935.981375:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819779328 00000100:00100000:1.0:1788687935.981378:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819779328 00000100:00100000:1.0:1788687935.981409:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819778944 00000100:00100000:1.0:1788687935.981412:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819778944 00000100:00100000:1.0:1788687935.981426:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819779200 00000100:00100000:1.0:1788687935.981428:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819779200 00000100:00100000:1.0:1788687935.981444:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:1.0:1788687935.981451:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3202fde6-7dbc-4316-b24e-66eae298a466+5:2347:x1875574819779328:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687935.981529:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3202fde6-7dbc-4316-b24e-66eae298a466+5:2347:x1875574819779328:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.981536:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:1.0:1788687935.981549:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:1.0:1788687935.981555:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:2347:x1875574819778944:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687935.981576:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:2347:x1875574819778944:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 22us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.981582:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:1.0:1788687935.981592:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00080000:0.0:1788687935.981863:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788687935.981868:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788687935.982318:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3202fde6-7dbc-4316-b24e-66eae298a466+5:2347:x1875574819779200:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788687935.982413:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3202fde6-7dbc-4316-b24e-66eae298a466+5:2347:x1875574819779200:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 808us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687935.982421:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000001:00080000:3.0:1788687936.048094:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1788687936.048109:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1788687936.048115:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1788687936.048123:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1788687936.048130:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:3.0:1788687936.049865:0:15165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788687936.049872:0:15165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788687934 -> 1788687935 00002000:00010000:3.0:1788687936.049874:0:15165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4099 00010000:00010000:3.0:1788687936.049889:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.049901:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.049910:0:15165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.049933:0:15165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4cc00 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687936.049939:0:15165:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.049948:0:15165:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.049981:0:15165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.049990:0:15165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099529de8/0xc2ddd83e7444a3cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687936.050086:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3f3c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+10:2346:x1875574819778304:12345-192.168.204.26@tcp:4:dd.0 Request processed in 118821us (119271us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788687936.050100:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:3.0:1788687936.050138:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:3.0:1788687936.050162:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:2347:x1875574819778560:12345-192.168.204.26@tcp:4:dd.0 00010000:00010000:3.0:1788687936.050205:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fc278ff/0xc2ddd83e7444a3da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.050232:0:15165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687936.050237:0:15165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687936.050562:0:15165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fc278ff/0xc2ddd83e7444a3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.050577:0:15165:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fc278ff/0xc2ddd83e7444a3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788687936.121105:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:3.0:1788687936.127170:0:16712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1788687936.127181:0:16712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4099 -> 4103 00010000:00010000:3.0:1788687936.127206:0:16712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.127252:0:16712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.127260:0:16712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.127266:0:16712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:3.0:1788687936.127271:0:16712:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.127280:0:16712:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.127299:0:16712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.127306:0:16712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788687936.128096:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:2347:x1875574819778432:12345-192.168.204.26@tcp:4:dd.0 Request processed in 189217us (194231us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788687936.128105:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000001:00080000:2.0:1788687936.168742:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1788687936.169388:0:15165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1788687936.169406:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fc278ff/0xc2ddd83e7444a3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.169437:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fc278ff/0xc2ddd83e7444a3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.169447:0:15165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fc278ff/0xc2ddd83e7444a3da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.169455:0:15165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687936.169460:0:15165:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fc278ff/0xc2ddd83e7444a3da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.169470:0:15165:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fc278ff/0xc2ddd83e7444a3da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.169508:0:15165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fc278ff/0xc2ddd83e7444a3da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.169516:0:15165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fc278ff/0xc2ddd83e7444a3da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687936.169622:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:2347:x1875574819778560:12345-192.168.204.26@tcp:4:dd.0 Request processed in 119458us (235708us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788687936.169633:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:1.0:1788687936.177881:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687936.177951:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687936.178074:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819779584 00000100:00100000:3.0:1788687936.178086:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819779584 00000100:00100000:3.0:1788687936.178149:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819779456 00000100:00100000:3.0:1788687936.178383:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819779456 00000100:00100000:3.0:1788687936.178424:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:3.0:1788687936.178434:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+6:2347:x1875574819779584:12345-192.168.204.26@tcp:4:dd.0 00002000:00010000:3.0:1788687936.178507:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9d363f, atime: 0x6a9d363e, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1788687936.178517:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444a3e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.178534:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1788687936.178538:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788687936.178545:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444a3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788687936.178560:0:15167:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444a3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687936.178568:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788687936.178914:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819779712 00000100:00100000:2.0:1788687936.178920:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819779712 00000100:00100000:2.0:1788687936.178950:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:2.0:1788687936.178958:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+8:2347:x1875574819779456:12345-192.168.204.26@tcp:4:dd.0 00010000:00010000:2.0:1788687936.178986:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002643a8e6/0xc2ddd83e7444a3e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.178995:0:15165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687936.178998:0:15165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687936.179002:0:15165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002643a8e6/0xc2ddd83e7444a3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.179012:0:15165:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002643a8e6/0xc2ddd83e7444a3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788687936.180333:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788687936.180367:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788687936.180455:0:16712:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788687936.180464:0:16712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788687936.182799:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819779840 00000100:00100000:3.0:1788687936.182812:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819779840 00000100:00100000:3.0:1788687936.182878:0:16712:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788687936.182886:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574819779968 00000100:00100000:3.0:1788687936.182888:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574819779968 00000100:00100000:2.0:1788687936.183935:0:16716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:2.0:1788687936.183950:0:16716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+11:2346:x1875574819779712:12345-192.168.204.26@tcp:4:dd.0 00010000:00010000:2.0:1788687936.183990:0:16716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006839585/0xc2ddd83e7444a3ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.184008:0:16716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687936.184013:0:16716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687936.184019:0:16716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006839585/0xc2ddd83e7444a3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.184102:0:16716:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006839585/0xc2ddd83e7444a3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788687936.240376:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1788687936.242089:0:15167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1788687936.242099:0:15167:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788687935 00002000:00010000:2.0:1788687936.242119:0:15167:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1788687936.242138:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444a3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.242153:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444a3e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.242230:0:15167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444a3e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.242238:0:15167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3e0aad400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687936.242244:0:15167:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444a3e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.242255:0:15167:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444a3e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.242283:0:15167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444a3e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.242291:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006403c3c9/0xc2ddd83e7444a3e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687936.242435:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+15:2347:x1875574819779584:12345-192.168.204.26@tcp:4:dd.0 Request processed in 63995us (64557us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788687936.242458:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:2.0:1788687936.242535:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:2.0:1788687936.242558:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+14:2346:x1875574819779840:12345-192.168.204.26@tcp:4:dd.0 00010000:00010000:2.0:1788687936.242599:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a85eca7e/0xc2ddd83e7444a3f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.242614:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687936.242619:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788687936.242627:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a85eca7e/0xc2ddd83e7444a3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.242640:0:15167:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a85eca7e/0xc2ddd83e7444a3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788687936.291285:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1788687936.291891:0:15165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1788687936.291898:0:15165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1788687936.291917:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002643a8e6/0xc2ddd83e7444a3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.291932:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002643a8e6/0xc2ddd83e7444a3e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.291942:0:15165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002643a8e6/0xc2ddd83e7444a3e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.291949:0:15165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4d800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687936.291955:0:15165:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002643a8e6/0xc2ddd83e7444a3e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.291980:0:15165:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002643a8e6/0xc2ddd83e7444a3e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.292006:0:15165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002643a8e6/0xc2ddd83e7444a3e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.292014:0:15165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002643a8e6/0xc2ddd83e7444a3e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687936.292135:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+12:2347:x1875574819779456:12345-192.168.204.26@tcp:4:dd.0 Request processed in 113170us (114177us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788687936.292147:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:0.0:1788687936.292185:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788687936.292199:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+11:2346:x1875574819779968:12345-192.168.204.26@tcp:4:dd.0 00010000:00010000:0.0:1788687936.292252:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.292265:0:15165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687936.292271:0:15165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788687936.292278:0:15165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.292290:0:15165:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788687936.292808:0:16716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1788687936.292820:0:16716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006839585/0xc2ddd83e7444a3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.292829:0:16716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006839585/0xc2ddd83e7444a3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.292837:0:16716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006839585/0xc2ddd83e7444a3ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.292843:0:16716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4c800 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687936.292846:0:16716:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006839585/0xc2ddd83e7444a3ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.292855:0:16716:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006839585/0xc2ddd83e7444a3ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.292879:0:16716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006839585/0xc2ddd83e7444a3ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.292888:0:16716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006839585/0xc2ddd83e7444a3ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687936.292935:0:16716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+11:2346:x1875574819779712:12345-192.168.204.26@tcp:4:dd.0 Request processed in 108987us (114369us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788687936.292943:0:16716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00010000:00010000:3.0:1788687936.326687:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788687936.330881:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1788687936.332673:0:15167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788687936.332685:0:15167:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788687936.332702:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a85eca7e/0xc2ddd83e7444a3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.332780:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a85eca7e/0xc2ddd83e7444a3f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.332791:0:15167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a85eca7e/0xc2ddd83e7444a3f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.332799:0:15167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f4b4d200 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:2.0:1788687936.332805:0:15167:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a85eca7e/0xc2ddd83e7444a3f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.332816:0:15167:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a85eca7e/0xc2ddd83e7444a3f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.332853:0:15167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a85eca7e/0xc2ddd83e7444a3f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788687936.332862:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a85eca7e/0xc2ddd83e7444a3f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788687936.333048:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+9:2346:x1875574819779840:12345-192.168.204.26@tcp:4:dd.0 Request processed in 90487us (152711us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788687936.333061:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000001:00080000:3.0:1788687936.370914:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1788687936.371313:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.371332:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.371343:0:15165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.371352:0:15165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af3f79ec400 already unused, calling callback (ffffffffc15ed340) 00010000:00010000:0.0:1788687936.371358:0:15165:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.371368:0:15165:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.371392:0:15165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788687936.371400:0:15165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b94dee63/0xc2ddd83e7444a3fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788687936.371586:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cc39b5e6-2458-4fe7-aa19-c77d8fd8e4c5+5:2346:x1875574819779968:12345-192.168.204.26@tcp:4:dd.0 Request processed in 79384us (191209us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788687936.371599:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:1.0:1788687936.581946:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788687936.581975:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c830ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839681024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788687936.583078:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c5b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839681152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788687936.583530:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687936.583651:0:15163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839681024 00000100:00100000:1.0:1788687936.583662:0:15163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839681024 00000100:00100000:1.0:1788687936.583771:0:15163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788687936.583788:0:15163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839681024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788687936.583847:0:15163:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788687936.583924:0:15163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839681024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687936.583932:0:15163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788687936.584013:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c830ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839681024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788687936.584108:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839681408:0@lo:400:kworker.0 00000100:00100000:3.0:1788687936.584139:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3c697dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77fc0cc6-2d57-47be-a26d-d352055b72d6:3311:1875574839681280:0@lo:400:kworker.0 00000100:00100000:1.0:1788687936.584167:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687936.584233:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788687936.584241:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839681536:0@lo:400:kworker.0 00000100:00100000:1.0:1788687936.584294:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687936.584332:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839681536 00000100:00100000:1.0:1788687936.584337:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839681536 00000100:00100000:1.0:1788687936.584391:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788687936.584401:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839681536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687936.584441:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875574839681536:12345-0@lo:400:kworker.0 Request processed in 42us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788687936.584448:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788687936.584478:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875574839681536:0@lo:400:kworker.0 00000100:00080000:1.0:1788687936.584532:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788687936.586400:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839681408 00000100:00100000:0.0:1788687936.586414:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839681408 00000100:00100000:0.0:1788687936.586476:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788687936.586512:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c830ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839681408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788687936.586792:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c830ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875574839681408:12345-0@lo:400:kworker.0 Request processed in 283us (2627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687936.586800:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788687936.586945:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788687936.586952:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9af3c830c700, transno 8589934595 00000004:00080000:0.0:1788687936.586969:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788687936.587008:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875574839681408:0@lo:400:kworker.0 00000100:00100000:3.0:1788687936.588214:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687936.588271:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839681792:0@lo:400:kworker.0 00000100:00100000:2.0:1788687936.588300:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687936.588326:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788687936.588360:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788687936.588378:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af3fba9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839681664:0@lo:400:kworker.0 00000100:00100000:0.0:1788687936.588529:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839681280 00000100:00100000:0.0:1788687936.588538:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839681280 00000100:00100000:0.0:1788687936.588585:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788687936.588595:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3d0013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:3311:x1875574839681280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687936.588641:0:15163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839681152 00000100:00100000:1.0:1788687936.588648:0:15163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839681152 00000100:00100000:3.0:1788687936.588678:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788687936.588690:0:15163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788687936.588699:0:15163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3c5b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839681152:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788687936.588718:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839681792 00002000:00000024:1.0:1788687936.588718:0:15163:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:3.0:1788687936.588724:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839681792 00000100:00100000:1.0:1788687936.588764:0:15163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3c5b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875574839681152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687936.588765:0:15887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875574839681664 00000100:00100000:3.0:1788687936.588770:0:15887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875574839681664 00000100:00100000:1.0:1788687936.588774:0:15163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788687936.588800:0:15887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788687936.588809:0:15887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839681792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788687936.588815:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788687936.588827:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9af3fba9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839681664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788687936.588854:0:15887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875574839681792:12345-0@lo:400:kworker.0 Request processed in 46us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788687936.588862:0:15887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788687936.588873:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3fba9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875574839681664:12345-0@lo:400:kworker.0 Request processed in 48us (195us total) trans 0 rc 0/0 00000100:00080000:3.0:1788687936.588881:0:14472:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788687936.588895:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788687936.588921:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875574839681664:0@lo:400:kworker.0 00000100:00100000:3.0:1788687936.588934:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3fba98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875574839681792:0@lo:400:kworker.0 00000100:00100000:2.0:1788687936.589255:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c5b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875574839681152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788687936.592454:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9af3d0013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fc0cc6-2d57-47be-a26d-d352055b72d6+19:3311:x1875574839681280:12345-0@lo:400:kworker.0 Request processed in 3849us (4243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788687936.592475:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788687936.592698:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af3c697dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77fc0cc6-2d57-47be-a26d-d352055b72d6:3311:1875574839681280:0@lo:400:kworker.0 00010000:00010000:1.0:1788687937.349962:0:14464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788687937.669314:0:16753:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788687938.373735:0:14465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29240 lines, 29240 kept, 0 dropped, 0 bad.